-- Logs begin at Mon 2022-07-11 11:20:46 UTC, end at Mon 2022-07-11 12:22:29 UTC. -- Jul 11 11:55:01.553956 dv-osbrick-849324-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 11 11:55:01.563579 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 11 11:55:01.565146 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 11:55:01 2022] *** Jul 11 11:55:01.565146 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 11:55:01.565146 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 11:55:01.565146 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: nodename: dv-osbrick-849324-1-ceph Jul 11 11:55:01.565146 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: machine: x86_64 Jul 11 11:55:01.565146 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: clock source: unix Jul 11 11:55:01.565146 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: pcre jit disabled Jul 11 11:55:01.565146 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: detected number of CPU cores: 4 Jul 11 11:55:01.565146 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: current working directory: / Jul 11 11:55:01.565146 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: detected binary path: /usr/bin/uwsgi-core Jul 11 11:55:01.565661 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: your processes number limit is 47680 Jul 11 11:55:01.565661 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: your memory page size is 4096 bytes Jul 11 11:55:01.565661 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: detected max file descriptor number: 2048 Jul 11 11:55:01.565661 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: lock engine: pthread robust mutexes Jul 11 11:55:01.565661 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: thunder lock: enabled Jul 11 11:55:01.565661 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 11 11:55:01.565661 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 11:55:01.615441 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: Python main interpreter initialized at 0x5629466439c0 Jul 11 11:55:01.615441 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: python threads support enabled Jul 11 11:55:01.615441 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: your server socket listen backlog is limited to 100 connections Jul 11 11:55:01.615441 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: your mercy for graceful operations on workers is 90 seconds Jul 11 11:55:01.615785 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 11:55:01.615854 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: *** Operational MODE: preforking *** Jul 11 11:55:01.616123 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: *** uWSGI is running in multiple interpreter mode *** Jul 11 11:55:01.616123 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: spawned uWSGI master process (pid: 87167) Jul 11 11:55:01.616322 dv-osbrick-849324-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 11 11:55:01.619600 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: spawned uWSGI worker 1 (pid: 87216, cores: 1) Jul 11 11:55:01.619600 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: spawned uWSGI worker 2 (pid: 87217, cores: 1) Jul 11 11:55:01.619600 dv-osbrick-849324-1-ceph devstack@keystone.service[87167]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 11:55:07.343742 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 11:55:07.343742 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: from cryptography.utils import int_from_bytes Jul 11 11:55:07.344519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 11:55:07.344519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: from cryptography.utils import int_from_bytes Jul 11 11:55:07.344928 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 11:55:07.344928 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: from cryptography.utils import int_from_bytes Jul 11 11:55:07.345036 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 11:55:07.345036 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: from cryptography.utils import int_from_bytes Jul 11 11:55:07.393863 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 11:55:07.394084 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 11:55:07.394191 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 11:55:07.394322 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] command line args: [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 11:55:07.394407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 11:55:07.394555 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] command line args: [] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 11:55:07.394637 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 11:55:07.394835 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ================================================================================ {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 11:55:07.394931 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 11:55:07.395010 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ================================================================================ {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 11:55:07.395085 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] admin_token = **** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.395249 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] admin_token = **** {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.395334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] config_dir = [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.395493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] config_dir = [] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.395583 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.395660 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] config_source = [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.395733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.395841 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] debug = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.395924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] config_source = [] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.396005 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] debug = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.396076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.396274 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.396424 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.396530 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.396637 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.396747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.396849 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.396950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.397044 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.397141 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.397251 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] list_limit = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.397347 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] list_limit = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.397444 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] log_config_append = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.397538 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] log_config_append = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.397635 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.397740 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.397843 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] log_dir = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.397943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] log_dir = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.398042 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] log_file = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.398147 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] log_file = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.398253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.398342 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.398459 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.398538 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.398657 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.398754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.398839 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.398923 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.399048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.399129 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.399211 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.399334 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.399408 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.399530 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.399636 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.399715 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.399871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.399987 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.400102 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.400191 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.400332 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.400414 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.400559 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.400639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.400803 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.400893 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.401043 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.401118 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.401315 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.401398 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.401796 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.401920 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.402001 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] publish_errors = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.402077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] publish_errors = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.402192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.402273 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.402405 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.402487 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.402567 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.402685 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.402828 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.402923 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.403057 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.403184 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.403288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] standard_threads = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.403369 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] standard_threads = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.403516 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.403632 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.403747 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.403831 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.403904 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.403973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.404075 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] use_journal = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.404152 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] use_journal = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.404247 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] use_json = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.404333 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] use_json = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.404405 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] use_stderr = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.404519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] use_stderr = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.404597 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] use_syslog = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.404673 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] use_syslog = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.404793 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.404886 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 11:55:07.405043 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.405125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.405276 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.405357 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.406069 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.406197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.406295 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.406392 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.406640 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.406782 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.406782 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.406986 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.407073 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.407144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.407251 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.407334 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.407496 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.407585 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.407739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.407823 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.407983 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.408065 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.408214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.408301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.408455 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.408531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.408688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.408776 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.408927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.409012 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.409161 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.409239 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.409395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.409471 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.409641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.409723 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.409891 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.409973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.410133 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.410215 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.410364 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.410447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.410612 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.410693 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.410890 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.410977 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.411141 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.411217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.411384 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.411465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.411613 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.411688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.411838 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.411915 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.412066 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.412147 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.412296 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.412371 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.412541 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.412623 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.412781 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.412867 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.413008 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.413083 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.413233 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.413309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.413475 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.413549 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.413716 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.413797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.413949 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.414034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.414193 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.414268 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.414420 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.414495 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.414656 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.414791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.414910 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.414985 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.415138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.415213 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.415363 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.415438 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.415589 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.415670 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.415813 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.415894 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.416047 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.416124 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.416288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.416369 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.416516 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.416600 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.416748 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.416823 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.416974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.417049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.417205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.417292 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.417439 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.417520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.417681 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.417762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.417908 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.418011 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.418140 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.418218 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.418372 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.418448 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.418604 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.418687 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.418861 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.418950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.419094 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.419171 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.419323 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.419408 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.419564 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.419649 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.419798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.419890 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.420030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.420106 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.420258 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.420336 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.420510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.420598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.420745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.420822 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.420971 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.421057 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.421255 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.421971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.422062 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.422135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.422236 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.422465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.422550 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.422724 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.422817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.422973 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.423056 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.423211 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.423290 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.423447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.423524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.423685 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.423763 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.423942 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.424058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.424158 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.424240 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.424393 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.424476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.424628 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.424706 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.424861 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.424938 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.425097 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.425181 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.425334 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.425412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.425566 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.425645 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.425800 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.425885 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.426073 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.426163 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.426290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.426371 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.426528 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.426607 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.426813 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.426889 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.427019 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.427097 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.427254 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.427331 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.427489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.427569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.427723 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.427809 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.427950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.428027 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.428179 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.428263 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.428406 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.428483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.428634 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.428710 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.428860 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.428943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.429087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.429169 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.429320 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.429399 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.429553 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.429636 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.429786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.429864 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.430023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.430100 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.430278 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.430365 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.430517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.430596 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.430764 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] auth.external = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.430855 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.430994 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.431082 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] auth.external = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.431228 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.431305 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.431500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.431586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.431730 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] auth.password = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.431809 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.431962 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] auth.password = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.432050 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] auth.token = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.432194 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] auth.token = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.432273 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.432427 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.432504 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.432661 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.432745 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.432888 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.432964 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.433124 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.433201 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.433366 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.433450 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.433597 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.433675 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.433826 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.433903 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] credential.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.434065 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] credential.caching = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.434153 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.434308 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.434386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.434553 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.434630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.434808 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.434889 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.435049 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.435128 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.435280 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.435357 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.435516 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.435595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.435780 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.435858 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.436018 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.436095 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.436257 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.436341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.436510 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.436589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.436786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.436867 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.437047 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.437134 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.437315 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.437456 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.437564 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.437716 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.437803 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.437952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] federation.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.438031 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] federation.caching = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.438188 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.438266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.438432 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.438518 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.438676 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.438776 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.438929 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.439007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.439174 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.439264 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.439409 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.439489 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.439659 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.439738 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.439892 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.439977 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.440140 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.440218 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.440374 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.440450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.440616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.440768 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.440843 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity.caching = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.440913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.441081 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.441159 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.441326 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.441411 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.441561 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.441638 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.441793 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.441870 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.442035 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.442120 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.442263 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.442341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.442499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.442582 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.442763 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.442860 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.443015 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.443094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.443245 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.443324 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.443473 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.443557 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.443700 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.443777 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.443942 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.444026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.444183 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.444268 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.444427 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.444505 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.444675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.444753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.444918 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.444997 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.445182 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.445266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.445416 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.445502 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.445650 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.445728 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.445877 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.445954 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.446117 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.446195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.446345 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.446423 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.446575 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.446690 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.446824 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.446937 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.447065 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.447145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.447308 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.447385 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.447539 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.447617 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.447784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.447862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.448025 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.448101 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.448258 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.448335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.448500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.448578 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.448743 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.448820 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.448969 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.449046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.449203 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.449282 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.449429 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.449505 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.449663 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.449740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.449893 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.449971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.450131 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.450272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.450354 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.450425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.450583 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.450663 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.450849 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.450930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.451095 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.451174 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.451332 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.451456 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.451540 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.451614 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.451783 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.451875 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.452028 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.452124 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.452259 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.452347 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.452532 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.452769 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.452906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.453034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.453151 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.453320 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.453407 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.453581 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.453678 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.453812 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.453891 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.454058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.454138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.454305 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.454391 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.454549 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.454627 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.454809 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.454891 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.455041 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.455131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.455268 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.455345 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.455500 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.455580 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.455731 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.455817 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.455958 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.456035 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.456185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.456263 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.456435 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.456520 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.456677 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.456755 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.456919 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.456996 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.457159 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.457244 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.457392 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.457469 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.457619 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.457697 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.457861 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.457939 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.458092 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.458169 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.458326 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.458404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.458558 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.458637 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.458811 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.458891 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.459057 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.459136 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.459298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.459377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.459535 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.459612 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.459769 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.459846 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.460012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.460090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.460244 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.460321 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.460480 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.460558 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.460712 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.460791 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.460948 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.461026 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.461191 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.461269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.461420 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.461498 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.461648 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.461724 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.461882 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.461961 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] resource.caching = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.462122 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] resource.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.462202 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.462365 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.462442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.462601 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.462679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.462857 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.462938 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.463106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.463184 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.463340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.463422 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.463567 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.463646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.463806 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.463885 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.464039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.464123 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.464271 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] role.caching = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.464349 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.464501 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] role.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.464578 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] role.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.464734 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.464811 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] role.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.464962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.465040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.465207 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.465285 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.465451 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.465528 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.465693 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.465772 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.465935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.466013 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.466176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.466253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.466416 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.466560 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.466698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.466805 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.466904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.466982 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.467131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.467210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.467373 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.467452 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.467617 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.467696 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.467860 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.467939 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.468619 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.468795 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.469011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.469098 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.469245 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.469323 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.469491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.469570 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.469738 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.469824 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.469984 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.470062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.470217 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.470295 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.470451 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.470536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.470702 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.470801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.470973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.471051 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.471209 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.471302 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.471434 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.471516 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.471662 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.471739 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.471894 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.471980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.472142 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.472221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.472390 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.472467 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.472632 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.472717 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.472869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.472946 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.473101 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.473180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.473338 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] token.caching = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.473424 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.473572 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] token.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.473649 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.473807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.473885 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.474040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.474125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.474276 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.474353 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.474527 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.474606 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.474787 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.474880 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.475022 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.475100 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.475263 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.475340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.475503 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.475588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.475737 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.475814 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.475971 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.476047 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.476201 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.476286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.476432 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.476508 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.476679 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.476755 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.476908 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.477005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.477137 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.477219 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.477543 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.477624 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.477705 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.477777 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.connection = **** {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.477891 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.connection = **** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.477984 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.478133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.478213 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.478367 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.478443 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.478599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.478684 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.478857 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.478935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.479088 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.479165 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.479321 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.479409 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.479551 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.479629 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.480037 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.480122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.480270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.480355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.480510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.480588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.480745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.480826 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.480976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.481062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.481215 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.481292 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.481446 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.481523 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.481673 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.481758 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.481901 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.481978 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.482133 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.482213 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.482284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87217) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 11:55:07.482364 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 11:55:07.482516 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 11:55:07.513054 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.513237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.513318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.513447 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.513608 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.513686 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.521991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.522101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.551024 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.551251 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.551515 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.551748 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.603156 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.603287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.653714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.653947 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.654148 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.654380 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.719282 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.719438 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.719519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.719596 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.719671 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.719744 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.719850 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.719935 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.720062 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.720145 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.720272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.720354 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.743890 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.744120 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.744217 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.744338 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.744423 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.744551 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.744634 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.744763 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.744844 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.744972 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.745061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.745182 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.745264 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.745396 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.758488 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.758767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.771969 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.772201 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.772427 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.772613 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.772697 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.772845 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.772928 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.773058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.773138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.773275 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87217) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.773363 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.773488 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.773699 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.773909 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87216) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 11:55:07.790995 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.791207 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 11:55:07.791367 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.791545 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.791696 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 11:55:07.791775 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 11:55:07.791893 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.791984 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.792091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 11:55:07.792279 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.792366 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.792506 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.792585 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.792761 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.792842 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.793075 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.803846 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.804106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.804204 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.804373 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.804454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.804633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.804713 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.804909 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.812897 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.813074 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.816209 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.816351 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.816484 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.816628 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.816761 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.816905 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.817040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.817179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.817434 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.817567 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.817696 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.817826 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.817968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.818092 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.818243 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.818363 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.818514 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.818628 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.818817 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.818919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.819089 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.819170 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.846501 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.846758 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.848132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.848376 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.848460 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.848656 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.853643 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.853920 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.854001 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.854195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.854275 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.854480 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.861769 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.862047 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.862217 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.862501 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.866628 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.866933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.867153 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.867236 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.867436 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.867517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.867715 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.867805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.867984 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.868064 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.868251 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.868331 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.868512 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.868601 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.868775 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.869039 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.887122 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.887391 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.887720 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.887997 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.892485 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.893111 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.896138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.896427 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.896792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.897086 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.901421 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.902085 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.905037 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.906292 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.909598 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.909893 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.910152 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.910246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.910448 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.910530 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.910744 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.910828 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.911040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.911124 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.911317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.911628 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.929855 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.930141 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.930501 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.930768 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.930853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.931060 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.931422 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.931688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.938601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.939667 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.940334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.940608 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.941373 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.941648 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.943649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.943929 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.944204 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.944487 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.944716 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.944799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.944997 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.945278 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.945568 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.945859 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.958854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.959127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.959400 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.959673 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.959762 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.959948 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.960032 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.960219 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.960310 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.960490 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.960572 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.960793 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.961070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.961356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.978974 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.979707 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.982430 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.983251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.986352 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.987255 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.987988 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.988881 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.989600 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.989874 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.990151 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.990516 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:07.990813 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.991092 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.997547 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.998506 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:07.999172 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:08.000835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:08.003090 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.003375 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.003655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.003929 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.004113 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.004402 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.004683 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.004956 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.014000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:08.014285 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.014569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.015223 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:08.015521 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.015795 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.022755 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87216) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:08.023035 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.023314 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.023581 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.023814 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87217) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 11:55:08.023914 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.024090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.024174 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.024367 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.024449 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.024628 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.024719 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.024900 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.024984 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.025167 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.025255 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.025436 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.025518 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.025692 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.025782 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.025948 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.026032 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.026198 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87216) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.026280 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.026489 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.026779 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.027044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.027301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87217) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 11:55:08.065122 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5629466439c0 pid: 87216 (default app) Jul 11 11:55:08.066032 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5629466439c0 pid: 87217 (default app) Jul 11 11:55:08.068512 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61794c6-6534-431f-81da-f834b7bee4db None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:08.068805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61794c6-6534-431f-81da-f834b7bee4db None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:08.069084 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61794c6-6534-431f-81da-f834b7bee4db None None] PATH_INFO: `/v3` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:08.073318 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Mon Jul 11 11:55:08 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:16.094880 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b085e-433c-4bff-9e58-917b34358dcf None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:16.095468 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b085e-433c-4bff-9e58-917b34358dcf None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:16.095468 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b085e-433c-4bff-9e58-917b34358dcf None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:16.099846 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:55:16.105320 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc08150-9af0-42ea-b155-0bcd8516a179 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:16.105736 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc08150-9af0-42ea-b155-0bcd8516a179 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:16.105862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc08150-9af0-42ea-b155-0bcd8516a179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:16.180325 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: INFO dbcounter [None req-9fc08150-9af0-42ea-b155-0bcd8516a179 None None] Registered counter for database keystone Jul 11 11:55:16.202244 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG oslo_db.sqlalchemy.engines [None req-9fc08150-9af0-42ea-b155-0bcd8516a179 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:55:16.208400 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writer thread running {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:55:16.389746 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG passlib.handlers.bcrypt [None req-9fc08150-9af0-42ea-b155-0bcd8516a179 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87216) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 11:55:16.389981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG passlib.handlers.bcrypt [None req-9fc08150-9af0-42ea-b155-0bcd8516a179 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87216) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 11:55:16.444125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-9fc08150-9af0-42ea-b155-0bcd8516a179 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:16.445712 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-9fc08150-9af0-42ea-b155-0bcd8516a179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:16.567447 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 11 11:55:16.750363 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b085e-433c-4bff-9e58-917b34358dcf None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:16.826161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: INFO dbcounter [None req-df7b085e-433c-4bff-9e58-917b34358dcf None None] Registered counter for database keystone Jul 11 11:55:16.846166 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG oslo_db.sqlalchemy.engines [None req-df7b085e-433c-4bff-9e58-917b34358dcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87217) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 11:55:16.852326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writer thread running {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 11:55:16.974379 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b085e-433c-4bff-9e58-917b34358dcf None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:16.978636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed381a2e-5e9f-45ff-b665-991d9bf0a182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:16.979321 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed381a2e-5e9f-45ff-b665-991d9bf0a182 admin admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:16.979866 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed381a2e-5e9f-45ff-b665-991d9bf0a182 admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:16.980144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed381a2e-5e9f-45ff-b665-991d9bf0a182 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:16.988759 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed381a2e-5e9f-45ff-b665-991d9bf0a182 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:17.039900 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ed381a2e-5e9f-45ff-b665-991d9bf0a182 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 11:55:17.040180 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed381a2e-5e9f-45ff-b665-991d9bf0a182 admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:17.050218 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Mon Jul 11 11:55:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 11:55:17.056143 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc08150-9af0-42ea-b155-0bcd8516a179 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:17.070975 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc08150-9af0-42ea-b155-0bcd8516a179 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:17.075380 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f269d25-1e0c-4d41-9ecf-6930f3aabdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:17.076571 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f269d25-1e0c-4d41-9ecf-6930f3aabdec admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:17.076862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f269d25-1e0c-4d41-9ecf-6930f3aabdec admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:17.077269 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f269d25-1e0c-4d41-9ecf-6930f3aabdec admin admin] PATH_INFO: `/v3/projects/33e4605bb55c438db190b2eb3cdd5cc7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:17.078816 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f269d25-1e0c-4d41-9ecf-6930f3aabdec admin admin] RBAC: Authorizing `identity:get_project(project_id=33e4605bb55c438db190b2eb3cdd5cc7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:17.131857 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5f269d25-1e0c-4d41-9ecf-6930f3aabdec admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 11:55:17.132407 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f269d25-1e0c-4d41-9ecf-6930f3aabdec admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:17.136764 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Mon Jul 11 11:55:17 2022] GET /identity/v3/projects/33e4605bb55c438db190b2eb3cdd5cc7 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:19.334738 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132975b4-9e66-4c75-a3e7-b31f472270e8 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:19.335271 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132975b4-9e66-4c75-a3e7-b31f472270e8 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:19.335366 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132975b4-9e66-4c75-a3e7-b31f472270e8 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:19.339523 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:19.345472 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a0014-ea14-459e-acfb-1e59bc91f14e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:19.347417 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a0014-ea14-459e-acfb-1e59bc91f14e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:19.347417 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a0014-ea14-459e-acfb-1e59bc91f14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:19.365498 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-714a0014-ea14-459e-acfb-1e59bc91f14e None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:19.367070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-714a0014-ea14-459e-acfb-1e59bc91f14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:19.375662 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 11:55:19.399790 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132975b4-9e66-4c75-a3e7-b31f472270e8 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:19.412380 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132975b4-9e66-4c75-a3e7-b31f472270e8 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:19.416564 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f42ccd-069c-46f2-a97f-965a130220c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:19.417194 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f42ccd-069c-46f2-a97f-965a130220c9 admin admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:19.417480 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f42ccd-069c-46f2-a97f-965a130220c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:19.417757 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f42ccd-069c-46f2-a97f-965a130220c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:19.426215 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f42ccd-069c-46f2-a97f-965a130220c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:19.428290 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f42ccd-069c-46f2-a97f-965a130220c9 admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:19.440655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Mon Jul 11 11:55:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 11:55:19.446457 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a0014-ea14-459e-acfb-1e59bc91f14e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:19.455600 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a0014-ea14-459e-acfb-1e59bc91f14e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:19.460002 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698298c-32e0-4b10-9d5e-a6f78ee60011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:19.460858 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698298c-32e0-4b10-9d5e-a6f78ee60011 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:19.461139 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698298c-32e0-4b10-9d5e-a6f78ee60011 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:19.461412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698298c-32e0-4b10-9d5e-a6f78ee60011 admin admin] PATH_INFO: `/v3/users/df8711dbef0e4322ab4112544df903c1` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:19.462825 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698298c-32e0-4b10-9d5e-a6f78ee60011 admin admin] RBAC: Authorizing `identity:get_user(user_id=df8711dbef0e4322ab4112544df903c1)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:19.464666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698298c-32e0-4b10-9d5e-a6f78ee60011 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:19.466232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Mon Jul 11 11:55:19 2022] GET /identity/v3/users/df8711dbef0e4322ab4112544df903c1 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:21.763981 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd04c50-140b-4ffb-babd-4b7a9cb23156 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:21.765339 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd04c50-140b-4ffb-babd-4b7a9cb23156 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:21.765339 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd04c50-140b-4ffb-babd-4b7a9cb23156 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:21.766607 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:21.771972 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28848ed-2871-47cc-ad81-d0f677678b58 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:21.772368 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28848ed-2871-47cc-ad81-d0f677678b58 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:21.772532 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28848ed-2871-47cc-ad81-d0f677678b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:21.774448 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7aaf9-95d4-4b39-bdda-d8c151c0411e None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:21.774753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7aaf9-95d4-4b39-bdda-d8c151c0411e None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:21.775042 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7aaf9-95d4-4b39-bdda-d8c151c0411e None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:21.776262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:55:21.781433 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d690a-5fdc-419d-98e3-b4b6364fd87e None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:21.781744 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d690a-5fdc-419d-98e3-b4b6364fd87e None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:21.782020 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d690a-5fdc-419d-98e3-b4b6364fd87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:21.789351 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-a28848ed-2871-47cc-ad81-d0f677678b58 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:21.790530 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a28848ed-2871-47cc-ad81-d0f677678b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:21.821835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG passlib.handlers.bcrypt [None req-db4d690a-5fdc-419d-98e3-b4b6364fd87e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87217) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 11:55:21.822279 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG passlib.handlers.bcrypt [None req-db4d690a-5fdc-419d-98e3-b4b6364fd87e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87217) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 11:55:21.868456 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-db4d690a-5fdc-419d-98e3-b4b6364fd87e None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:21.870024 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-db4d690a-5fdc-419d-98e3-b4b6364fd87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:21.870482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:55:21.895828 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28848ed-2871-47cc-ad81-d0f677678b58 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:21.919481 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:21.971798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:55:21.996395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d690a-5fdc-419d-98e3-b4b6364fd87e None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:22.101902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d690a-5fdc-419d-98e3-b4b6364fd87e None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:22.104212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:22.108908 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28848ed-2871-47cc-ad81-d0f677678b58 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:22.142037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c59981-fd1a-43ef-a6ef-00895d30c4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:22.142961 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c59981-fd1a-43ef-a6ef-00895d30c4fc None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:22.143249 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c59981-fd1a-43ef-a6ef-00895d30c4fc None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:22.143531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c59981-fd1a-43ef-a6ef-00895d30c4fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:22.144772 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5b935-045f-4d43-b5aa-86178f46aaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:22.145568 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5b935-045f-4d43-b5aa-86178f46aaf8 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:22.145855 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5b935-045f-4d43-b5aa-86178f46aaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:22.146139 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5b935-045f-4d43-b5aa-86178f46aaf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:22.157457 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5b935-045f-4d43-b5aa-86178f46aaf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:22.168714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-5bf5b935-045f-4d43-b5aa-86178f46aaf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:55:22.168714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:22.168714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:22.168714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:22.168714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:22.168714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:22.168714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:22.168714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:22.168714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:22.168714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:22.168714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:22.168714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:22.168714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:22.168714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:22.168714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:22.168714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:22.169691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:22.169691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:22.169691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:22.169691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:22.169691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:22.169691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:22.169691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:22.169691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:22.169691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:22.169691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:22.169691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:22.169691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:22.169691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:22.169691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:22.169691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:22.169691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:22.171101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:22.171101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:22.171101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:22.171101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:22.171101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:22.171101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:22.171101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:22.171101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:22.171101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:22.171101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:22.171101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:55:22.171101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:55:22.171101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:55:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:55:22.176874 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5b935-045f-4d43-b5aa-86178f46aaf8 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:22.217098 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c59981-fd1a-43ef-a6ef-00895d30c4fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:22.218632 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c59981-fd1a-43ef-a6ef-00895d30c4fc None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:22.260172 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:22.279536 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5b935-045f-4d43-b5aa-86178f46aaf8 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:22.314188 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2f3db-e14e-4370-ad01-546ab4e6d676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:22.314893 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2f3db-e14e-4370-ad01-546ab4e6d676 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:22.315232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2f3db-e14e-4370-ad01-546ab4e6d676 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:22.315511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2f3db-e14e-4370-ad01-546ab4e6d676 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:22.316261 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2f3db-e14e-4370-ad01-546ab4e6d676 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:22.316569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2f3db-e14e-4370-ad01-546ab4e6d676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:22.317707 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 8/15] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:55:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 11:55:22.317989 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2f3db-e14e-4370-ad01-546ab4e6d676 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:22.323381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c59981-fd1a-43ef-a6ef-00895d30c4fc None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:22.330409 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:22.332719 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 8/16] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:22.338166 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2f3db-e14e-4370-ad01-546ab4e6d676 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:22.426053 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c59981-fd1a-43ef-a6ef-00895d30c4fc None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:22.438564 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2f3db-e14e-4370-ad01-546ab4e6d676 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:22.459306 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531e661-e2de-49ba-a2d6-36bfbf72798b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:22.460098 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531e661-e2de-49ba-a2d6-36bfbf72798b None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:22.460378 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531e661-e2de-49ba-a2d6-36bfbf72798b None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:22.460653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531e661-e2de-49ba-a2d6-36bfbf72798b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:22.471834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c39f3-d48a-4584-a00c-67f33859b38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:22.472698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c39f3-d48a-4584-a00c-67f33859b38a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:22.472985 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c39f3-d48a-4584-a00c-67f33859b38a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:22.473258 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c39f3-d48a-4584-a00c-67f33859b38a None admin] PATH_INFO: `/v3/users/df8711dbef0e4322ab4112544df903c1` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:22.474481 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c39f3-d48a-4584-a00c-67f33859b38a None admin] RBAC: Authorizing `identity:get_user(user_id=df8711dbef0e4322ab4112544df903c1)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:22.475985 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c39f3-d48a-4584-a00c-67f33859b38a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:22.477602 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:22 2022] GET /identity/v3/users/df8711dbef0e4322ab4112544df903c1 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:22.479276 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531e661-e2de-49ba-a2d6-36bfbf72798b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:22.480995 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531e661-e2de-49ba-a2d6-36bfbf72798b None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:22.484047 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c39f3-d48a-4584-a00c-67f33859b38a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:22.498770 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:22.504447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-4531e661-e2de-49ba-a2d6-36bfbf72798b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:55:22.504447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:22.504447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:22.504447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:22.504447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:22.504447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:22.504447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:22.504447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:22.504447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:22.504447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:22.504447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:22.504447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:22.504447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:55:22.504447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:55:22.504447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:22.505252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:22.506021 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:55:22.506021 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:55:22.506021 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:55:22.506021 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:55:22.506021 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:55:22.511353 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531e661-e2de-49ba-a2d6-36bfbf72798b None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:22.590151 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c39f3-d48a-4584-a00c-67f33859b38a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:22.627065 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c09074-b6e5-446d-a373-0aa943f25383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:22.627865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c09074-b6e5-446d-a373-0aa943f25383 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:22.628146 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c09074-b6e5-446d-a373-0aa943f25383 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:22.628420 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c09074-b6e5-446d-a373-0aa943f25383 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:22.629612 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c09074-b6e5-446d-a373-0aa943f25383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:22.631112 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c09074-b6e5-446d-a373-0aa943f25383 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:22.632790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:55:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:22.638599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c09074-b6e5-446d-a373-0aa943f25383 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:22.673612 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:22.716304 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531e661-e2de-49ba-a2d6-36bfbf72798b None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:22.719867 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:22.739738 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c09074-b6e5-446d-a373-0aa943f25383 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:22.751072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc14586-a630-4e18-8cdf-e1409800d17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:22.751729 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc14586-a630-4e18-8cdf-e1409800d17f None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:22.752012 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc14586-a630-4e18-8cdf-e1409800d17f None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:22.752288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc14586-a630-4e18-8cdf-e1409800d17f None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:22.753005 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc14586-a630-4e18-8cdf-e1409800d17f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:22.753308 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc14586-a630-4e18-8cdf-e1409800d17f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:22.754699 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc14586-a630-4e18-8cdf-e1409800d17f None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:22.772825 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:22.773386 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4741d-050a-4af1-93ec-56d6312696f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:22.773960 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4741d-050a-4af1-93ec-56d6312696f2 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:22.774250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4741d-050a-4af1-93ec-56d6312696f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:22.774528 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4741d-050a-4af1-93ec-56d6312696f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:22.775396 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4741d-050a-4af1-93ec-56d6312696f2 None admin] RBAC: Adding query filter params (role.id=11fc9dc7c3664b2b8af8eee2462707b8, scope.domain.id=default, user.id=df8711dbef0e4322ab4112544df903c1) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:22.775711 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4741d-050a-4af1-93ec-56d6312696f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:22.777188 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4741d-050a-4af1-93ec-56d6312696f2 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:22.785446 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 11/21] 10.222.0.25 () {56 vars in 1322 bytes} [Mon Jul 11 11:55:22 2022] GET /identity/v3/role_assignments?user.id=df8711dbef0e4322ab4112544df903c1&scope.domain.id=default&role.id=11fc9dc7c3664b2b8af8eee2462707b8 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:25.552973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00873fc1-1825-47fd-856c-333720468161 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:25.553537 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00873fc1-1825-47fd-856c-333720468161 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:25.553537 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00873fc1-1825-47fd-856c-333720468161 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:25.555369 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:25.561644 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a524bcd-4144-400c-9f4a-440e8eba68fd None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:25.562363 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a524bcd-4144-400c-9f4a-440e8eba68fd None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:25.562363 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a524bcd-4144-400c-9f4a-440e8eba68fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:25.588234 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-4a524bcd-4144-400c-9f4a-440e8eba68fd None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:25.589453 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4a524bcd-4144-400c-9f4a-440e8eba68fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:25.683475 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:25.727892 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00873fc1-1825-47fd-856c-333720468161 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:25.739777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed63bd-0f15-4218-964c-4d3300dc242b None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:25.740070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed63bd-0f15-4218-964c-4d3300dc242b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:25.740350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed63bd-0f15-4218-964c-4d3300dc242b None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:25.741728 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:25 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:25.748243 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9df431-5608-4c03-91fb-ddce3a07f292 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:25.748564 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9df431-5608-4c03-91fb-ddce3a07f292 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:25.748916 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9df431-5608-4c03-91fb-ddce3a07f292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:25.787854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-5c9df431-5608-4c03-91fb-ddce3a07f292 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:25.789063 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5c9df431-5608-4c03-91fb-ddce3a07f292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:25.914593 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00873fc1-1825-47fd-856c-333720468161 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:25.932450 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:25.932648 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 14/25] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:25.934232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0754a-e665-454e-a34c-f9447b6831e2 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:25.934689 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0754a-e665-454e-a34c-f9447b6831e2 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:25.937601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0754a-e665-454e-a34c-f9447b6831e2 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:25.939480 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 15/26] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:25.944690 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0912c-2f63-4d0a-a45a-a5581c2de761 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:25.945181 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0912c-2f63-4d0a-a45a-a5581c2de761 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:25.945643 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0912c-2f63-4d0a-a45a-a5581c2de761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:25.954478 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a4bc0-380b-4c0c-a1e7-e86c843575b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:25.955317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a4bc0-380b-4c0c-a1e7-e86c843575b0 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:25.955602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a4bc0-380b-4c0c-a1e7-e86c843575b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:25.955880 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a4bc0-380b-4c0c-a1e7-e86c843575b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:25.969188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a4bc0-380b-4c0c-a1e7-e86c843575b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:25.978333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-477a4bc0-380b-4c0c-a1e7-e86c843575b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:55:25.978333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:25.978333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:25.978333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:25.978333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:25.978333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:25.978333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:25.978333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:25.978333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:25.978333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:25.978333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:25.978333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:25.978333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:25.978333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:25.978333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:25.978333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:25.979211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:25.979211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:25.979211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:25.979211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:25.979211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:25.979211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:25.979211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:25.979211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:25.979211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:25.979211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:25.979211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:25.979211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:25.979211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:25.979211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:25.979211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:25.979211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:25.980212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:25.980212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:25.980212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:25.980212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:25.980212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:25.980212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:25.980212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:25.980212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:25.980212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:25.980212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:25.980212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:55:25.980212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:55:25.980212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 12/27] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:55:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:25.980830 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a4bc0-380b-4c0c-a1e7-e86c843575b0 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:25.981791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:26.000165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-cbf0912c-2f63-4d0a-a45a-a5581c2de761 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:26.001605 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-cbf0912c-2f63-4d0a-a45a-a5581c2de761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:26.096022 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a4bc0-380b-4c0c-a1e7-e86c843575b0 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:26.125902 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 16/28] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:26.127020 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0912c-2f63-4d0a-a45a-a5581c2de761 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:26.133082 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd1663-d5da-489a-ace8-706d6576278b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:26.134438 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd1663-d5da-489a-ace8-706d6576278b None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:26.134438 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd1663-d5da-489a-ace8-706d6576278b None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:26.134704 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd1663-d5da-489a-ace8-706d6576278b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:26.146336 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd1663-d5da-489a-ace8-706d6576278b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:26.148002 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd1663-d5da-489a-ace8-706d6576278b None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:26.169044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-16dd1663-d5da-489a-ace8-706d6576278b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:55:26.169044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:26.169044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:26.169044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:26.169044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:26.169044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:26.169044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:26.169044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:26.169044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:26.169044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:26.169044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:26.169044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:26.169044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:55:26.169044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:55:26.169044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:26.169896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:26.171082 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:55:26.171082 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:55:26.171082 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:55:26.171082 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:55:26.171082 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 13/29] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:26.171345 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd1663-d5da-489a-ace8-706d6576278b None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:26.203547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:26.282631 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd1663-d5da-489a-ace8-706d6576278b None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:26.291266 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0912c-2f63-4d0a-a45a-a5581c2de761 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:26.319685 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae287dcd-bfc7-430c-b344-0cbba39d7eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:26.320262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae287dcd-bfc7-430c-b344-0cbba39d7eed None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:26.320618 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae287dcd-bfc7-430c-b344-0cbba39d7eed None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:26.320964 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae287dcd-bfc7-430c-b344-0cbba39d7eed None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:26.321783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae287dcd-bfc7-430c-b344-0cbba39d7eed None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:26.323533 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae287dcd-bfc7-430c-b344-0cbba39d7eed None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:26.331657 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d5644-1284-4b67-8021-17228768e859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:26.332874 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d5644-1284-4b67-8021-17228768e859 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:26.332874 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d5644-1284-4b67-8021-17228768e859 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:26.333180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d5644-1284-4b67-8021-17228768e859 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:26.333981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d5644-1284-4b67-8021-17228768e859 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:26.334230 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d5644-1284-4b67-8021-17228768e859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:26.335871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d5644-1284-4b67-8021-17228768e859 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:26.337422 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:26.345940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 17/30] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:26.346825 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d5644-1284-4b67-8021-17228768e859 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:26.460491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d5644-1284-4b67-8021-17228768e859 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:26.466875 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 14/31] 10.222.0.25 () {60 vars in 1131 bytes} [Mon Jul 11 11:55:26 2022] POST /identity/v3/roles => generated 225 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:55:26.469353 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b958b-fdb9-4422-8b58-7a93392622f7 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:26.469966 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b958b-fdb9-4422-8b58-7a93392622f7 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:26.470473 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b958b-fdb9-4422-8b58-7a93392622f7 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:26.472673 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 15/32] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:26.473818 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b958b-fdb9-4422-8b58-7a93392622f7 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:26.497972 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b0461-ab27-49c5-be81-a9fe3fb633ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:26.499265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b0461-ab27-49c5-be81-a9fe3fb633ff None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:26.499554 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b0461-ab27-49c5-be81-a9fe3fb633ff None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:26.500033 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b0461-ab27-49c5-be81-a9fe3fb633ff None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:26.500793 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b0461-ab27-49c5-be81-a9fe3fb633ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:26.501102 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b0461-ab27-49c5-be81-a9fe3fb633ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:26.502565 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b0461-ab27-49c5-be81-a9fe3fb633ff None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:26.523391 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 18/33] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:26.523818 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831534e6-dbdd-4c54-9bd0-8dc136eb29a4 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:26.524108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831534e6-dbdd-4c54-9bd0-8dc136eb29a4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:26.524384 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831534e6-dbdd-4c54-9bd0-8dc136eb29a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:26.542502 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-831534e6-dbdd-4c54-9bd0-8dc136eb29a4 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:26.543780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-831534e6-dbdd-4c54-9bd0-8dc136eb29a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:26.600026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:26.606027 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:26.620769 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 19/34] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:26.621646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831534e6-dbdd-4c54-9bd0-8dc136eb29a4 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:26.638222 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b958b-fdb9-4422-8b58-7a93392622f7 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:26.682182 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bf97a-b054-48fe-af01-061fd84461ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:26.683161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bf97a-b054-48fe-af01-061fd84461ce None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:26.683449 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bf97a-b054-48fe-af01-061fd84461ce None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:26.683777 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bf97a-b054-48fe-af01-061fd84461ce None admin] PATH_INFO: `/v3/users/df8711dbef0e4322ab4112544df903c1` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:26.687161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77bf97a-b054-48fe-af01-061fd84461ce None admin] RBAC: Authorizing `identity:get_user(user_id=df8711dbef0e4322ab4112544df903c1)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:26.689578 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77bf97a-b054-48fe-af01-061fd84461ce None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:26.691932 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 16/35] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:26 2022] GET /identity/v3/users/df8711dbef0e4322ab4112544df903c1 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:26.693693 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078f688-9f12-43ef-a61d-7adc33556825 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:26.693983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078f688-9f12-43ef-a61d-7adc33556825 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:26.694397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078f688-9f12-43ef-a61d-7adc33556825 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:26.695897 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 17/36] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:26.696622 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078f688-9f12-43ef-a61d-7adc33556825 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:26.761996 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831534e6-dbdd-4c54-9bd0-8dc136eb29a4 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:26.802583 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6c24d-cd5a-431d-ae5e-0f1cba96f0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:26.803292 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6c24d-cd5a-431d-ae5e-0f1cba96f0bb None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:26.803575 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6c24d-cd5a-431d-ae5e-0f1cba96f0bb None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:26.803850 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6c24d-cd5a-431d-ae5e-0f1cba96f0bb None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:26.804558 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6c24d-cd5a-431d-ae5e-0f1cba96f0bb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:26.806032 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6c24d-cd5a-431d-ae5e-0f1cba96f0bb None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:26.846982 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078f688-9f12-43ef-a61d-7adc33556825 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:26.884659 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b450d9-c04d-4d71-b13e-99741588696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:26.885732 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b450d9-c04d-4d71-b13e-99741588696d None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:26.886231 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b450d9-c04d-4d71-b13e-99741588696d None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:26.886801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b450d9-c04d-4d71-b13e-99741588696d None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:26.887826 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b450d9-c04d-4d71-b13e-99741588696d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:26.890160 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b450d9-c04d-4d71-b13e-99741588696d None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:26.905687 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1131 bytes} [Mon Jul 11 11:55:26 2022] POST /identity/v3/roles => generated 219 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:55:26.906836 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b450d9-c04d-4d71-b13e-99741588696d None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:26.941188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:26.952534 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 20/38] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Jul 11 11:55:26 2022] POST /identity/v3/projects => generated 301 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:55:26.954315 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d90933-a494-4225-9598-65d01a4c0223 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:26.954603 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d90933-a494-4225-9598-65d01a4c0223 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:26.954975 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d90933-a494-4225-9598-65d01a4c0223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:26.978778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-51d90933-a494-4225-9598-65d01a4c0223 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:26.978778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-51d90933-a494-4225-9598-65d01a4c0223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:27.017213 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:27.066090 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 21/39] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:27.096076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b450d9-c04d-4d71-b13e-99741588696d None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:27.107807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d90933-a494-4225-9598-65d01a4c0223 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:27.143701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f753fa-fb92-4b36-9781-6112ff917234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:27.144512 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f753fa-fb92-4b36-9781-6112ff917234 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:27.144799 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f753fa-fb92-4b36-9781-6112ff917234 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:27.145077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f753fa-fb92-4b36-9781-6112ff917234 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:27.146418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f753fa-fb92-4b36-9781-6112ff917234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:27.148069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f753fa-fb92-4b36-9781-6112ff917234 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:27.149777 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 19/40] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:55:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:27.156409 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f753fa-fb92-4b36-9781-6112ff917234 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:27.253406 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d90933-a494-4225-9598-65d01a4c0223 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:27.268664 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:27.288140 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f753fa-fb92-4b36-9781-6112ff917234 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:27.298036 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76167fd2-b8ec-4b7c-a35f-569d362e6f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:27.298792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167fd2-b8ec-4b7c-a35f-569d362e6f25 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:27.299274 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167fd2-b8ec-4b7c-a35f-569d362e6f25 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:27.299527 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167fd2-b8ec-4b7c-a35f-569d362e6f25 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:27.300669 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76167fd2-b8ec-4b7c-a35f-569d362e6f25 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:27.301955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76167fd2-b8ec-4b7c-a35f-569d362e6f25 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:27.318234 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 22/41] 10.222.0.25 () {60 vars in 1131 bytes} [Mon Jul 11 11:55:27 2022] POST /identity/v3/roles => generated 223 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:55:27.327032 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce66c2-0a6f-469e-80f1-47ea7a95f799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:27.327893 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce66c2-0a6f-469e-80f1-47ea7a95f799 None admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:27.328177 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce66c2-0a6f-469e-80f1-47ea7a95f799 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:27.328455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce66c2-0a6f-469e-80f1-47ea7a95f799 None admin] PATH_INFO: `/v3/domains/default/users/df8711dbef0e4322ab4112544df903c1/roles/11fc9dc7c3664b2b8af8eee2462707b8` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:27.330662 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce66c2-0a6f-469e-80f1-47ea7a95f799 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=df8711dbef0e4322ab4112544df903c1, role_id=11fc9dc7c3664b2b8af8eee2462707b8)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:27.332287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce66c2-0a6f-469e-80f1-47ea7a95f799 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:27.349595 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 20/42] 10.222.0.25 () {58 vars in 1361 bytes} [Mon Jul 11 11:55:27 2022] PUT /identity/v3/domains/default/users/df8711dbef0e4322ab4112544df903c1/roles/11fc9dc7c3664b2b8af8eee2462707b8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:55:27.542774 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5d779-2ca0-458e-9dc1-150f4f4a9889 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:27.543058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5d779-2ca0-458e-9dc1-150f4f4a9889 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:27.543343 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5d779-2ca0-458e-9dc1-150f4f4a9889 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:27.545004 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 23/43] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:27.551049 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608c3bc-0cfd-45b7-874f-2bd8746bd470 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:27.551349 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608c3bc-0cfd-45b7-874f-2bd8746bd470 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:27.551786 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608c3bc-0cfd-45b7-874f-2bd8746bd470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:27.571246 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-1608c3bc-0cfd-45b7-874f-2bd8746bd470 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:27.572799 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-1608c3bc-0cfd-45b7-874f-2bd8746bd470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:27.641976 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 21/44] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:27.666658 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5d779-2ca0-458e-9dc1-150f4f4a9889 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:27.695944 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:27.772056 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5d779-2ca0-458e-9dc1-150f4f4a9889 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:27.807241 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76de540-6794-49e3-a314-972fe376f96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:27.807959 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76de540-6794-49e3-a314-972fe376f96b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:27.808246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76de540-6794-49e3-a314-972fe376f96b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:27.808524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76de540-6794-49e3-a314-972fe376f96b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:27.809707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76de540-6794-49e3-a314-972fe376f96b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:27.811264 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76de540-6794-49e3-a314-972fe376f96b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:27.813048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 24/45] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:55:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:27.818680 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608c3bc-0cfd-45b7-874f-2bd8746bd470 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:27.892714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:27.918380 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608c3bc-0cfd-45b7-874f-2bd8746bd470 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:27.952048 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd1152-84ff-40c3-8798-2d814e54bb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:27.952718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd1152-84ff-40c3-8798-2d814e54bb01 None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:27.953062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd1152-84ff-40c3-8798-2d814e54bb01 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:27.953345 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd1152-84ff-40c3-8798-2d814e54bb01 None admin] PATH_INFO: `/v3/projects` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:27.954055 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd1152-84ff-40c3-8798-2d814e54bb01 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:27.955548 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd1152-84ff-40c3-8798-2d814e54bb01 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:27.983985 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 22/46] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Jul 11 11:55:27 2022] POST /identity/v3/projects => generated 312 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:55:29.605631 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92147ec6-49f8-4265-8f97-0f6a274ff247 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:29.606146 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92147ec6-49f8-4265-8f97-0f6a274ff247 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:29.606229 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92147ec6-49f8-4265-8f97-0f6a274ff247 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:29.607601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 25/47] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:29.612944 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f30a8-ffa4-4dd8-9f1d-392aad400b73 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:29.613341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f30a8-ffa4-4dd8-9f1d-392aad400b73 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:29.613514 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f30a8-ffa4-4dd8-9f1d-392aad400b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:29.630369 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-f78f30a8-ffa4-4dd8-9f1d-392aad400b73 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:29.631601 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-f78f30a8-ffa4-4dd8-9f1d-392aad400b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:29.697281 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 23/48] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:29.722297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92147ec6-49f8-4265-8f97-0f6a274ff247 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:29.816600 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:29.824159 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92147ec6-49f8-4265-8f97-0f6a274ff247 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:29.858934 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91004d08-2a88-4dc1-9d72-212c39654ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:29.859657 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91004d08-2a88-4dc1-9d72-212c39654ab2 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:29.859946 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91004d08-2a88-4dc1-9d72-212c39654ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:29.860229 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91004d08-2a88-4dc1-9d72-212c39654ab2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:29.870441 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91004d08-2a88-4dc1-9d72-212c39654ab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:29.878240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-91004d08-2a88-4dc1-9d72-212c39654ab2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:55:29.878240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:29.878240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:29.878240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:29.878240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:29.878240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:29.878240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:29.878240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:29.878240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:29.878240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:29.878240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:29.878240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:29.878240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:29.878240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:29.878240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:29.878240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:29.879235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:29.879235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:29.879235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:29.879235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:29.879235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:29.879235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:29.879235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:29.879235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:29.879235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:29.879235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:29.879235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:29.879235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:29.879235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:29.879235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:29.879235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:29.879235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:29.880250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:29.880250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:29.880250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:29.880250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:29.880250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:29.880250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:29.880250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:29.880250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:29.880250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:29.880250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:29.880250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:55:29.880250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:55:29.880250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 26/49] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:55:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:29.885150 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f30a8-ffa4-4dd8-9f1d-392aad400b73 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:29.941813 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:29.986600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f30a8-ffa4-4dd8-9f1d-392aad400b73 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:30.020974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d078854-4291-4a3e-9200-195971c15fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:30.021644 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d078854-4291-4a3e-9200-195971c15fac None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:30.021929 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d078854-4291-4a3e-9200-195971c15fac None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:30.022204 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d078854-4291-4a3e-9200-195971c15fac None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:30.022982 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d078854-4291-4a3e-9200-195971c15fac None admin] RBAC: Adding query filter params (name=admin) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:30.023290 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d078854-4291-4a3e-9200-195971c15fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:30.024669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d078854-4291-4a3e-9200-195971c15fac None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:30.036074 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 24/50] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:30.041929 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91004d08-2a88-4dc1-9d72-212c39654ab2 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:30.144619 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91004d08-2a88-4dc1-9d72-212c39654ab2 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:30.181015 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9db8d-30cf-4719-93b1-c93256e1556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:30.181924 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9db8d-30cf-4719-93b1-c93256e1556f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:30.182210 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9db8d-30cf-4719-93b1-c93256e1556f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:30.182494 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9db8d-30cf-4719-93b1-c93256e1556f None admin] PATH_INFO: `/v3/users/df8711dbef0e4322ab4112544df903c1` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:30.183731 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9db8d-30cf-4719-93b1-c93256e1556f None admin] RBAC: Authorizing `identity:get_user(user_id=df8711dbef0e4322ab4112544df903c1)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:30.185210 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9db8d-30cf-4719-93b1-c93256e1556f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:30.187389 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 27/51] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:30 2022] GET /identity/v3/users/df8711dbef0e4322ab4112544df903c1 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:30.192912 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d078854-4291-4a3e-9200-195971c15fac None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:30.205666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a314aa-118d-4349-b1d5-6d9e5ab1fc7b None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:30.205955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a314aa-118d-4349-b1d5-6d9e5ab1fc7b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:30.206231 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a314aa-118d-4349-b1d5-6d9e5ab1fc7b None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:30.207617 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 28/52] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:55:30.212300 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad61c5f-8082-4a2c-9b45-f7599692b5b9 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:30.212589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad61c5f-8082-4a2c-9b45-f7599692b5b9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:30.212868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad61c5f-8082-4a2c-9b45-f7599692b5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:30.229152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-8ad61c5f-8082-4a2c-9b45-f7599692b5b9 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:30.230624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8ad61c5f-8082-4a2c-9b45-f7599692b5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:30.247839 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:30.294050 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d078854-4291-4a3e-9200-195971c15fac None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:30.301207 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 29/53] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:55:30.312190 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:30.325840 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad61c5f-8082-4a2c-9b45-f7599692b5b9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:30.331010 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fc1d6-50f1-484e-b244-cac6cec465f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:30.331814 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fc1d6-50f1-484e-b244-cac6cec465f3 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:30.332161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fc1d6-50f1-484e-b244-cac6cec465f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:30.332441 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fc1d6-50f1-484e-b244-cac6cec465f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:30.333621 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fc1d6-50f1-484e-b244-cac6cec465f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:30.335114 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fc1d6-50f1-484e-b244-cac6cec465f3 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:30.336739 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 25/54] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:55:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:30.342572 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fc1d6-50f1-484e-b244-cac6cec465f3 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:30.431164 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad61c5f-8082-4a2c-9b45-f7599692b5b9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:30.442063 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fc1d6-50f1-484e-b244-cac6cec465f3 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:30.465922 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f59a1-88c1-4ebc-9153-1ffe1f06dc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:30.466734 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f59a1-88c1-4ebc-9153-1ffe1f06dc51 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:30.467156 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f59a1-88c1-4ebc-9153-1ffe1f06dc51 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:30.467442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f59a1-88c1-4ebc-9153-1ffe1f06dc51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:30.468622 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f59a1-88c1-4ebc-9153-1ffe1f06dc51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:30.470081 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f59a1-88c1-4ebc-9153-1ffe1f06dc51 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:30.471728 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 30/55] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:55:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:30.475294 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2ff9d-ab27-4132-8079-e188a5f6b783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:30.475992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2ff9d-ab27-4132-8079-e188a5f6b783 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:30.476246 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2ff9d-ab27-4132-8079-e188a5f6b783 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:30.476524 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2ff9d-ab27-4132-8079-e188a5f6b783 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:30.477124 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f59a1-88c1-4ebc-9153-1ffe1f06dc51 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:30.477355 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2ff9d-ab27-4132-8079-e188a5f6b783 None admin] RBAC: Adding query filter params (role.id=11fc9dc7c3664b2b8af8eee2462707b8, scope.domain.id=default, user.id=df8711dbef0e4322ab4112544df903c1) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:30.477669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2ff9d-ab27-4132-8079-e188a5f6b783 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:30.479153 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2ff9d-ab27-4132-8079-e188a5f6b783 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:30.488190 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 26/56] 10.222.0.25 () {56 vars in 1322 bytes} [Mon Jul 11 11:55:30 2022] GET /identity/v3/role_assignments?user.id=df8711dbef0e4322ab4112544df903c1&scope.domain.id=default&role.id=11fc9dc7c3664b2b8af8eee2462707b8 => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:30.503438 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:30.584903 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f59a1-88c1-4ebc-9153-1ffe1f06dc51 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:30.622169 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585bc44-f3f4-473f-a652-26453ff2013d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:30.622870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585bc44-f3f4-473f-a652-26453ff2013d None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:30.623900 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585bc44-f3f4-473f-a652-26453ff2013d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:30.624345 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585bc44-f3f4-473f-a652-26453ff2013d None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:30.625081 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585bc44-f3f4-473f-a652-26453ff2013d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:30.626606 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585bc44-f3f4-473f-a652-26453ff2013d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:30.653271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 31/57] 10.222.0.25 () {60 vars in 1140 bytes} [Mon Jul 11 11:55:30 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:55:32.867753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c99b52-e3c6-47eb-a98c-bce645a5d130 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:32.868277 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c99b52-e3c6-47eb-a98c-bce645a5d130 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:32.868361 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c99b52-e3c6-47eb-a98c-bce645a5d130 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:32.869661 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 27/58] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:32.875475 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0d8a5-f0d9-4ba5-9231-4817c72ca3b7 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:32.875886 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0d8a5-f0d9-4ba5-9231-4817c72ca3b7 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:32.876048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0d8a5-f0d9-4ba5-9231-4817c72ca3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:32.892886 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-ebc0d8a5-f0d9-4ba5-9231-4817c72ca3b7 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:32.894072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ebc0d8a5-f0d9-4ba5-9231-4817c72ca3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:32.959893 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 32/59] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:32.986239 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c99b52-e3c6-47eb-a98c-bce645a5d130 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:33.035991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:33.084673 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c99b52-e3c6-47eb-a98c-bce645a5d130 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:33.117594 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7011f-4757-4cca-acca-3efd9ab6744c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:33.118423 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7011f-4757-4cca-acca-3efd9ab6744c None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:33.118658 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7011f-4757-4cca-acca-3efd9ab6744c None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:33.118960 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7011f-4757-4cca-acca-3efd9ab6744c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:33.120121 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7011f-4757-4cca-acca-3efd9ab6744c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:33.121570 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7011f-4757-4cca-acca-3efd9ab6744c None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:33.123222 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 28/60] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:55:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:33.128620 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0d8a5-f0d9-4ba5-9231-4817c72ca3b7 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:33.132088 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:33.228483 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0d8a5-f0d9-4ba5-9231-4817c72ca3b7 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:33.262509 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49d8cd-1f6f-4011-b337-256deb63fc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:33.263194 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49d8cd-1f6f-4011-b337-256deb63fc1f None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:33.263479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49d8cd-1f6f-4011-b337-256deb63fc1f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:33.264451 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49d8cd-1f6f-4011-b337-256deb63fc1f None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:33.265282 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49d8cd-1f6f-4011-b337-256deb63fc1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:33.266754 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49d8cd-1f6f-4011-b337-256deb63fc1f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:33.291879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 33/61] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Jul 11 11:55:33 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:55:36.646152 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e164f-665c-4054-bf1d-278483ce5dad None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:36.646914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e164f-665c-4054-bf1d-278483ce5dad None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:36.646914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e164f-665c-4054-bf1d-278483ce5dad None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:36.648373 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 29/62] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:36.654686 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee27ec3-6df0-4eef-a913-beea6375ad87 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:36.655670 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee27ec3-6df0-4eef-a913-beea6375ad87 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:36.656164 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee27ec3-6df0-4eef-a913-beea6375ad87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:36.684599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-8ee27ec3-6df0-4eef-a913-beea6375ad87 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:36.686385 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8ee27ec3-6df0-4eef-a913-beea6375ad87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:36.778062 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:36.796844 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 34/63] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:36.833874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e164f-665c-4054-bf1d-278483ce5dad None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:37.004005 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e164f-665c-4054-bf1d-278483ce5dad None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:37.027038 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:37.062687 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15827627-6d24-45b4-9436-b07487eac63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:37.063883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15827627-6d24-45b4-9436-b07487eac63b None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:37.064344 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae8833-f2a3-4e97-8267-066ae3a44dff None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:37.064471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15827627-6d24-45b4-9436-b07487eac63b None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:37.064684 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15827627-6d24-45b4-9436-b07487eac63b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:37.065162 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae8833-f2a3-4e97-8267-066ae3a44dff None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:37.065649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae8833-f2a3-4e97-8267-066ae3a44dff None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:37.067271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 35/64] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:37.078815 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b3443-bb47-4249-8c1a-c97b13cd126b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:37.079182 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b3443-bb47-4249-8c1a-c97b13cd126b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:37.079382 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b3443-bb47-4249-8c1a-c97b13cd126b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:37.097874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15827627-6d24-45b4-9436-b07487eac63b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:37.108653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-15827627-6d24-45b4-9436-b07487eac63b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:55:37.108653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:37.108653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:37.108653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:37.108653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:37.108653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:37.108653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:37.108653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:37.108653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:37.108653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:37.108653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:37.108653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:37.108653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:37.108653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:37.108653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:37.108653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:37.110149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:37.110149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:37.110149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:37.110149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:37.110149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:37.110149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:37.110149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:37.110149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:37.110149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:37.110149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:37.110149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:37.110149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:37.110149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:37.110149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:37.110149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:37.110149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:37.110953 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:37.110953 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:37.110953 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:37.110953 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:37.110953 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:37.110953 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:37.110953 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:37.110953 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:37.110953 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:37.110953 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:37.110953 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:55:37.110953 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:55:37.110953 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 30/65] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:37.116362 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c08b3443-bb47-4249-8c1a-c97b13cd126b None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:37.118262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15827627-6d24-45b4-9436-b07487eac63b None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:37.121602 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c08b3443-bb47-4249-8c1a-c97b13cd126b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:37.231978 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 36/66] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:55:37.242307 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ebc6-51d5-475a-a582-8a68b0f1428b None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:37.243304 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ebc6-51d5-475a-a582-8a68b0f1428b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:37.243877 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ebc6-51d5-475a-a582-8a68b0f1428b None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:37.246071 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 37/67] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:37 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:37.252652 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497103be-8a07-4841-99f8-013dc38cb119 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:37.253070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497103be-8a07-4841-99f8-013dc38cb119 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:37.254808 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497103be-8a07-4841-99f8-013dc38cb119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:37.283715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-497103be-8a07-4841-99f8-013dc38cb119 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:37.285235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-497103be-8a07-4841-99f8-013dc38cb119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:37.285957 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15827627-6d24-45b4-9436-b07487eac63b None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:37.332457 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee6403-9ecb-43bd-b378-ca6c526116f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:37.333146 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee6403-9ecb-43bd-b378-ca6c526116f4 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:37.333439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee6403-9ecb-43bd-b378-ca6c526116f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:37.333724 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee6403-9ecb-43bd-b378-ca6c526116f4 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:37.334493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee6403-9ecb-43bd-b378-ca6c526116f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:37.334864 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee6403-9ecb-43bd-b378-ca6c526116f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:37.336299 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee6403-9ecb-43bd-b378-ca6c526116f4 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:37.353716 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 31/68] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:55:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:37.353716 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee6403-9ecb-43bd-b378-ca6c526116f4 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:37.380607 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 38/69] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:55:37.382260 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b70b4d-7bdb-4896-92c6-41a59fca11e5 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:37.382625 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b70b4d-7bdb-4896-92c6-41a59fca11e5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:37.383012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b70b4d-7bdb-4896-92c6-41a59fca11e5 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:37.385059 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 39/70] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:37.385723 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b70b4d-7bdb-4896-92c6-41a59fca11e5 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:37.418760 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:37.455832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:37.488244 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee6403-9ecb-43bd-b378-ca6c526116f4 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:37.508490 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b70b4d-7bdb-4896-92c6-41a59fca11e5 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:37.521103 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca4e94-2fba-4675-a1bb-3c3286e109a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:37.521915 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4e94-2fba-4675-a1bb-3c3286e109a6 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:37.522203 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4e94-2fba-4675-a1bb-3c3286e109a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:37.522480 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4e94-2fba-4675-a1bb-3c3286e109a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:37.533607 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca4e94-2fba-4675-a1bb-3c3286e109a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:37.541636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-a3ca4e94-2fba-4675-a1bb-3c3286e109a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:55:37.541636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:37.541636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:37.541636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:37.541636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:37.541636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:37.541636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:37.541636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:37.541636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:37.541636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:37.541636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:37.541636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:37.541636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:37.541636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:37.541636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:37.541636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:37.542465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:37.542465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:37.542465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:37.542465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:37.542465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:37.542465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:37.542465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:37.542465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:37.542465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:37.542465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:37.542465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:37.542465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:37.542465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:37.542465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:37.542465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:37.542465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:37.543253 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:37.543253 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:37.543253 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:37.543253 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:37.543253 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:37.543253 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:37.543253 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:37.543253 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:37.543253 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:37.543253 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:37.543253 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:55:37.543253 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:55:37.543905 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad11bb-518a-43b1-bad5-b1de8af7d4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:37.543994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 32/71] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:55:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:37.544060 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad11bb-518a-43b1-bad5-b1de8af7d4e2 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:37.544060 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad11bb-518a-43b1-bad5-b1de8af7d4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:37.544060 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad11bb-518a-43b1-bad5-b1de8af7d4e2 None admin] PATH_INFO: `/v3/users/ae590453bcf24b44a05cef758b0a5f0e` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:37.544217 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4542c8-f30a-4e32-8f9e-bd47fe70eb97 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:37.544376 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4542c8-f30a-4e32-8f9e-bd47fe70eb97 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:37.544721 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4542c8-f30a-4e32-8f9e-bd47fe70eb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:37.562580 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad11bb-518a-43b1-bad5-b1de8af7d4e2 None admin] RBAC: Authorizing `identity:get_user(user_id=ae590453bcf24b44a05cef758b0a5f0e)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:37.563026 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-2a4542c8-f30a-4e32-8f9e-bd47fe70eb97 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:37.564168 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad11bb-518a-43b1-bad5-b1de8af7d4e2 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:37.564263 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-2a4542c8-f30a-4e32-8f9e-bd47fe70eb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:37.565871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 40/72] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:37 2022] GET /identity/v3/users/ae590453bcf24b44a05cef758b0a5f0e => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:37.566639 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad11bb-518a-43b1-bad5-b1de8af7d4e2 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:37.635827 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 33/73] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:37.637151 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d73ae-ec94-4ccb-917f-2a3a2a7e7609 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:37.637441 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d73ae-ec94-4ccb-917f-2a3a2a7e7609 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:37.637718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d73ae-ec94-4ccb-917f-2a3a2a7e7609 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:37.639001 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 34/74] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:37.639694 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d73ae-ec94-4ccb-917f-2a3a2a7e7609 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:37.674467 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad11bb-518a-43b1-bad5-b1de8af7d4e2 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:37.683205 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:37.684852 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:37.711878 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93454a-1a80-4a05-af76-d97a290825dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:37.712672 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93454a-1a80-4a05-af76-d97a290825dc None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:37.712961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93454a-1a80-4a05-af76-d97a290825dc None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:37.713238 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93454a-1a80-4a05-af76-d97a290825dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:37.724893 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93454a-1a80-4a05-af76-d97a290825dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:37.733941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-9c93454a-1a80-4a05-af76-d97a290825dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:55:37.733941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:37.733941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:37.733941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:37.733941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:37.733941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:37.733941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:37.733941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:37.733941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:37.733941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:37.733941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:37.733941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:37.733941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:37.733941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:37.733941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:37.733941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:37.734834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:37.734834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:37.734834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:37.734834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:37.734834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:37.734834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:37.734834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:37.734834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:37.734834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:37.734834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:37.734834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:37.734834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:37.734834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:37.734834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:37.734834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:37.734834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:37.735935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:37.735935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:37.735935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:37.735935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:37.735935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:37.735935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:37.735935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:37.735935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:37.735935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:37.735935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:37.735935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:55:37.735935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:55:37.735935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 41/75] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:55:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:37.736767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93454a-1a80-4a05-af76-d97a290825dc None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:37.759058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d73ae-ec94-4ccb-917f-2a3a2a7e7609 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:37.793320 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82234b-5942-43e0-9cb3-2935d18a5434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:37.794063 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82234b-5942-43e0-9cb3-2935d18a5434 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:37.794353 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82234b-5942-43e0-9cb3-2935d18a5434 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:37.794663 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82234b-5942-43e0-9cb3-2935d18a5434 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:37.795491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82234b-5942-43e0-9cb3-2935d18a5434 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:37.795800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82234b-5942-43e0-9cb3-2935d18a5434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:37.797267 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82234b-5942-43e0-9cb3-2935d18a5434 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:37.805232 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 35/76] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:55:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:37.806455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8391b6-777e-477e-a9b4-99f4f4dd0705 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:37.806768 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8391b6-777e-477e-a9b4-99f4f4dd0705 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:37.807054 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8391b6-777e-477e-a9b4-99f4f4dd0705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:37.822777 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-6c8391b6-777e-477e-a9b4-99f4f4dd0705 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:37.823971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-6c8391b6-777e-477e-a9b4-99f4f4dd0705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:37.837843 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93454a-1a80-4a05-af76-d97a290825dc None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:37.871968 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2525e-2213-4061-9de0-c5585b3568c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:37.872613 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2525e-2213-4061-9de0-c5585b3568c6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:37.872913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2525e-2213-4061-9de0-c5585b3568c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:37.873193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2525e-2213-4061-9de0-c5585b3568c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:37.891246 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 36/77] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:37.892095 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8391b6-777e-477e-a9b4-99f4f4dd0705 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:37.907727 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:37.928289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:37.941788 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2525e-2213-4061-9de0-c5585b3568c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:37.943344 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2525e-2213-4061-9de0-c5585b3568c6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:38.002095 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8391b6-777e-477e-a9b4-99f4f4dd0705 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:38.037135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c5e65-6686-47ef-987f-44c9c94c8bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:38.037858 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c5e65-6686-47ef-987f-44c9c94c8bd9 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:38.038139 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c5e65-6686-47ef-987f-44c9c94c8bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:38.038414 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c5e65-6686-47ef-987f-44c9c94c8bd9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:38.041146 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 42/78] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:55:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:55:38.041740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2525e-2213-4061-9de0-c5585b3568c6 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:38.053328 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c5e65-6686-47ef-987f-44c9c94c8bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:38.061188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-1d2c5e65-6686-47ef-987f-44c9c94c8bd9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:55:38.061188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:38.061188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:38.061188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:38.061188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:38.061188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:38.061188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:38.061188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:38.061188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:38.061188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:38.061188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:38.061188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:38.061188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:38.061188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:38.061188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:38.061188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:38.062034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:38.062034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:38.062034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:38.062034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:38.062034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:38.062034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:38.062034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:38.062034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:38.062034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:38.062034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:38.062034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:38.062034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:38.062034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:38.062034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:38.062034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:38.062034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:38.062792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:38.062792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:38.062792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:38.062792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:38.062792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:38.062792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:38.062792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:38.062792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:38.062792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:38.062792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:38.062792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:55:38.062792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:55:38.062792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 37/79] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:38.063418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c5e65-6686-47ef-987f-44c9c94c8bd9 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:38.108803 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:38.141747 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2525e-2213-4061-9de0-c5585b3568c6 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:38.147895 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:38.170150 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c5e65-6686-47ef-987f-44c9c94c8bd9 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:38.179625 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0e7eb-9439-47c4-af43-6a90771d07cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:38.180306 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0e7eb-9439-47c4-af43-6a90771d07cb None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:38.180599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0e7eb-9439-47c4-af43-6a90771d07cb None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:38.180886 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0e7eb-9439-47c4-af43-6a90771d07cb None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:38.181651 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0e7eb-9439-47c4-af43-6a90771d07cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:38.181962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0e7eb-9439-47c4-af43-6a90771d07cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:38.183383 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0e7eb-9439-47c4-af43-6a90771d07cb None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:38.192245 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 43/80] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:38.193057 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0e7eb-9439-47c4-af43-6a90771d07cb None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:38.211180 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ac19a-1c35-4ba6-93db-a7de3af721c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:38.212056 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ac19a-1c35-4ba6-93db-a7de3af721c3 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:38.212341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ac19a-1c35-4ba6-93db-a7de3af721c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:38.212617 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ac19a-1c35-4ba6-93db-a7de3af721c3 None admin] PATH_INFO: `/v3/users/ae590453bcf24b44a05cef758b0a5f0e` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:38.213828 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ac19a-1c35-4ba6-93db-a7de3af721c3 None admin] RBAC: Authorizing `identity:get_user(user_id=ae590453bcf24b44a05cef758b0a5f0e)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:38.215378 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ac19a-1c35-4ba6-93db-a7de3af721c3 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:38.220557 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 38/81] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:38 2022] GET /identity/v3/users/ae590453bcf24b44a05cef758b0a5f0e => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:38.220557 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ac19a-1c35-4ba6-93db-a7de3af721c3 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:38.296464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0e7eb-9439-47c4-af43-6a90771d07cb None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:38.316258 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ac19a-1c35-4ba6-93db-a7de3af721c3 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:38.325273 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:38.332055 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46485a1-d49e-42c5-8a3a-b3cd94c23dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:38.332846 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46485a1-d49e-42c5-8a3a-b3cd94c23dbd None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:38.333135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46485a1-d49e-42c5-8a3a-b3cd94c23dbd None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:38.333416 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46485a1-d49e-42c5-8a3a-b3cd94c23dbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:38.334593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46485a1-d49e-42c5-8a3a-b3cd94c23dbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:38.336095 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46485a1-d49e-42c5-8a3a-b3cd94c23dbd None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:38.337722 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 44/82] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:55:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:38.338494 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46485a1-d49e-42c5-8a3a-b3cd94c23dbd None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:38.352314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aee60-0edc-49ec-9c41-3c5826552418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:38.353181 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aee60-0edc-49ec-9c41-3c5826552418 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:38.353467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aee60-0edc-49ec-9c41-3c5826552418 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:38.353745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aee60-0edc-49ec-9c41-3c5826552418 None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:38.355226 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9aee60-0edc-49ec-9c41-3c5826552418 None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:38.356695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9aee60-0edc-49ec-9c41-3c5826552418 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:38.358485 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 39/83] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:38 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:38.362927 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aee60-0edc-49ec-9c41-3c5826552418 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:38.382577 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:38.439321 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46485a1-d49e-42c5-8a3a-b3cd94c23dbd None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:38.464059 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aee60-0edc-49ec-9c41-3c5826552418 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:38.472407 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ff255-871e-450f-b244-9b12859e5ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:38.473061 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ff255-871e-450f-b244-9b12859e5ba9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:38.473342 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ff255-871e-450f-b244-9b12859e5ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:38.473616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ff255-871e-450f-b244-9b12859e5ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:38.474355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ff255-871e-450f-b244-9b12859e5ba9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:38.474661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ff255-871e-450f-b244-9b12859e5ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:38.476115 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ff255-871e-450f-b244-9b12859e5ba9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:38.484607 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 45/84] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:55:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:38.485488 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ff255-871e-450f-b244-9b12859e5ba9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:38.497444 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a7ec3-bfea-42e5-a0a0-5209f6e1811b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:38.499121 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a7ec3-bfea-42e5-a0a0-5209f6e1811b None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:38.499410 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a7ec3-bfea-42e5-a0a0-5209f6e1811b None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:38.499686 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a7ec3-bfea-42e5-a0a0-5209f6e1811b None admin] PATH_INFO: `/v3/users/df8711dbef0e4322ab4112544df903c1` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:38.500893 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a7ec3-bfea-42e5-a0a0-5209f6e1811b None admin] RBAC: Authorizing `identity:get_user(user_id=df8711dbef0e4322ab4112544df903c1)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:38.502356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a7ec3-bfea-42e5-a0a0-5209f6e1811b None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:38.504042 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 40/85] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:38 2022] GET /identity/v3/users/df8711dbef0e4322ab4112544df903c1 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:38.504791 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a7ec3-bfea-42e5-a0a0-5209f6e1811b None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:38.546233 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:38.588634 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ff255-871e-450f-b244-9b12859e5ba9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:38.589072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:38.605566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a7ec3-bfea-42e5-a0a0-5209f6e1811b None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:38.623848 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02bc38-4d91-441a-866a-7e6dae05351c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:38.624498 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02bc38-4d91-441a-866a-7e6dae05351c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:38.624782 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02bc38-4d91-441a-866a-7e6dae05351c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:38.625060 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02bc38-4d91-441a-866a-7e6dae05351c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:38.640728 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7eaab-e9e3-40d7-9595-395f4263d188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:38.641411 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7eaab-e9e3-40d7-9595-395f4263d188 None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:38.641702 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7eaab-e9e3-40d7-9595-395f4263d188 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:38.641986 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7eaab-e9e3-40d7-9595-395f4263d188 None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:38.642728 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7eaab-e9e3-40d7-9595-395f4263d188 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:38.644971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7eaab-e9e3-40d7-9595-395f4263d188 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:38.686742 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 41/86] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Jul 11 11:55:38 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:55:38.686742 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7eaab-e9e3-40d7-9595-395f4263d188 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:38.695386 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02bc38-4d91-441a-866a-7e6dae05351c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:38.696996 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02bc38-4d91-441a-866a-7e6dae05351c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:38.764674 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:38.810343 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7eaab-e9e3-40d7-9595-395f4263d188 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:38.818893 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 46/87] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:55:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:55:38.818893 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02bc38-4d91-441a-866a-7e6dae05351c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:38.850165 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a398fe-b6a6-4f7e-aad9-1af92b951764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:38.850797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a398fe-b6a6-4f7e-aad9-1af92b951764 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:38.851091 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a398fe-b6a6-4f7e-aad9-1af92b951764 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:38.851368 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a398fe-b6a6-4f7e-aad9-1af92b951764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:38.852205 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a398fe-b6a6-4f7e-aad9-1af92b951764 None admin] RBAC: Adding query filter params (role.id=a4345a1838084e3494c3e85dfb3225b4, scope.project.id=d2bf11410fd84f91989477a0c73ba52d, user.id=ae590453bcf24b44a05cef758b0a5f0e) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:38.852520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a398fe-b6a6-4f7e-aad9-1af92b951764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:38.853973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a398fe-b6a6-4f7e-aad9-1af92b951764 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:38.860476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 42/88] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:55:38 2022] GET /identity/v3/role_assignments?user.id=ae590453bcf24b44a05cef758b0a5f0e&scope.project.id=d2bf11410fd84f91989477a0c73ba52d&role.id=a4345a1838084e3494c3e85dfb3225b4 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:38.861373 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a398fe-b6a6-4f7e-aad9-1af92b951764 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:38.873408 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:38.953224 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02bc38-4d91-441a-866a-7e6dae05351c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:38.995305 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a40156-1eaf-48d4-83bc-fed591561268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:38.996197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a40156-1eaf-48d4-83bc-fed591561268 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:38.996493 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a40156-1eaf-48d4-83bc-fed591561268 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:38.996760 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a40156-1eaf-48d4-83bc-fed591561268 None admin] PATH_INFO: `/v3/users/ae590453bcf24b44a05cef758b0a5f0e` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:38.999620 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a40156-1eaf-48d4-83bc-fed591561268 None admin] RBAC: Authorizing `identity:get_user(user_id=ae590453bcf24b44a05cef758b0a5f0e)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:39.001138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a40156-1eaf-48d4-83bc-fed591561268 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:39.002898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a398fe-b6a6-4f7e-aad9-1af92b951764 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:39.003861 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 47/89] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:38 2022] GET /identity/v3/users/ae590453bcf24b44a05cef758b0a5f0e => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:39.004709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a40156-1eaf-48d4-83bc-fed591561268 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:39.042931 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff948b-d2ca-4f5e-a4b7-c85e49d842c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:39.043605 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff948b-d2ca-4f5e-a4b7-c85e49d842c6 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:39.043897 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff948b-d2ca-4f5e-a4b7-c85e49d842c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:39.044177 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff948b-d2ca-4f5e-a4b7-c85e49d842c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:39.045112 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:39.130287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff948b-d2ca-4f5e-a4b7-c85e49d842c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:39.132032 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff948b-d2ca-4f5e-a4b7-c85e49d842c6 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:39.143836 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:39.154401 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a40156-1eaf-48d4-83bc-fed591561268 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:39.218903 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2893b1-542b-4c7a-ba0c-62786bad0031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:39.220039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2893b1-542b-4c7a-ba0c-62786bad0031 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:39.220330 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2893b1-542b-4c7a-ba0c-62786bad0031 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:39.220668 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2893b1-542b-4c7a-ba0c-62786bad0031 None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:39.222571 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2893b1-542b-4c7a-ba0c-62786bad0031 None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:39.224574 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2893b1-542b-4c7a-ba0c-62786bad0031 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:39.227020 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 48/90] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:39 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:39.227803 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2893b1-542b-4c7a-ba0c-62786bad0031 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:39.268201 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 43/91] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:55:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:55:39.269401 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff948b-d2ca-4f5e-a4b7-c85e49d842c6 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:39.364795 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:39.374404 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2893b1-542b-4c7a-ba0c-62786bad0031 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:39.392827 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff948b-d2ca-4f5e-a4b7-c85e49d842c6 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:39.408211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:39.417604 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a63f1-4f50-4c94-b69a-8651828b7296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:39.418279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a63f1-4f50-4c94-b69a-8651828b7296 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:39.418573 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a63f1-4f50-4c94-b69a-8651828b7296 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:39.418900 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a63f1-4f50-4c94-b69a-8651828b7296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:39.468219 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ed4d0-5cbb-426e-8d48-cb6d9d5adb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:39.468990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ed4d0-5cbb-426e-8d48-cb6d9d5adb9f None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:39.469282 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ed4d0-5cbb-426e-8d48-cb6d9d5adb9f None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:39.469557 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ed4d0-5cbb-426e-8d48-cb6d9d5adb9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:39.470386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ed4d0-5cbb-426e-8d48-cb6d9d5adb9f None admin] RBAC: Adding query filter params (role.id=7b0becbc0d8a464b83a0b90da1e48a67, scope.project.id=d2bf11410fd84f91989477a0c73ba52d, user.id=ae590453bcf24b44a05cef758b0a5f0e) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:39.470697 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ed4d0-5cbb-426e-8d48-cb6d9d5adb9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:39.472205 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ed4d0-5cbb-426e-8d48-cb6d9d5adb9f None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:39.478741 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 44/92] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:55:39 2022] GET /identity/v3/role_assignments?user.id=ae590453bcf24b44a05cef758b0a5f0e&scope.project.id=d2bf11410fd84f91989477a0c73ba52d&role.id=7b0becbc0d8a464b83a0b90da1e48a67 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:39.479929 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ed4d0-5cbb-426e-8d48-cb6d9d5adb9f None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:39.510154 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a63f1-4f50-4c94-b69a-8651828b7296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:39.511755 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a63f1-4f50-4c94-b69a-8651828b7296 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:39.634764 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:39.644367 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 49/93] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:55:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:55:39.650314 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a63f1-4f50-4c94-b69a-8651828b7296 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:39.739342 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ed4d0-5cbb-426e-8d48-cb6d9d5adb9f None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:39.827256 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0972c-9a47-4041-b2fb-ed5ed150d742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:39.828137 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0972c-9a47-4041-b2fb-ed5ed150d742 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:39.828423 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0972c-9a47-4041-b2fb-ed5ed150d742 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:39.828700 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0972c-9a47-4041-b2fb-ed5ed150d742 None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:39.829941 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0972c-9a47-4041-b2fb-ed5ed150d742 None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:39.831451 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0972c-9a47-4041-b2fb-ed5ed150d742 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:39.833525 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 45/94] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:39 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:39.839715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a63f1-4f50-4c94-b69a-8651828b7296 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:39.840491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0972c-9a47-4041-b2fb-ed5ed150d742 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:39.914359 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8991f-eb7d-4b87-b663-1dd55fd3c0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:39.915225 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8991f-eb7d-4b87-b663-1dd55fd3c0bc None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:39.915516 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8991f-eb7d-4b87-b663-1dd55fd3c0bc None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:39.915795 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8991f-eb7d-4b87-b663-1dd55fd3c0bc None admin] PATH_INFO: `/v3/projects/ef565d7dde194ab5beaeb9815600c4a4` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:39.916999 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8991f-eb7d-4b87-b663-1dd55fd3c0bc None admin] RBAC: Authorizing `identity:get_project(project_id=ef565d7dde194ab5beaeb9815600c4a4)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:39.918470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8991f-eb7d-4b87-b663-1dd55fd3c0bc None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:39.920585 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 50/95] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:39 2022] GET /identity/v3/projects/ef565d7dde194ab5beaeb9815600c4a4 => generated 312 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:39.928343 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8991f-eb7d-4b87-b663-1dd55fd3c0bc None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:39.939075 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:40.053098 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0972c-9a47-4041-b2fb-ed5ed150d742 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:40.116729 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:40.118658 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680ac11-f7f7-4598-b2cf-bb0c25c994ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:40.119372 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680ac11-f7f7-4598-b2cf-bb0c25c994ce None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:40.119662 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680ac11-f7f7-4598-b2cf-bb0c25c994ce None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:40.119947 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680ac11-f7f7-4598-b2cf-bb0c25c994ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:40.121098 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680ac11-f7f7-4598-b2cf-bb0c25c994ce None admin] RBAC: Adding query filter params (role.id=11fc9dc7c3664b2b8af8eee2462707b8, scope.project.id=d2bf11410fd84f91989477a0c73ba52d, user.id=df8711dbef0e4322ab4112544df903c1) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:40.121469 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680ac11-f7f7-4598-b2cf-bb0c25c994ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:40.124287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680ac11-f7f7-4598-b2cf-bb0c25c994ce None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:40.137960 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 46/96] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:55:39 2022] GET /identity/v3/role_assignments?user.id=df8711dbef0e4322ab4112544df903c1&scope.project.id=d2bf11410fd84f91989477a0c73ba52d&role.id=11fc9dc7c3664b2b8af8eee2462707b8 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:40.201661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8991f-eb7d-4b87-b663-1dd55fd3c0bc None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:40.245094 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617ac14-a085-4a15-a355-e9447594a9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:40.245770 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617ac14-a085-4a15-a355-e9447594a9b4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:40.246061 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617ac14-a085-4a15-a355-e9447594a9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:40.246351 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617ac14-a085-4a15-a355-e9447594a9b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:40.247243 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617ac14-a085-4a15-a355-e9447594a9b4 None admin] RBAC: Adding query filter params (role.id=a4345a1838084e3494c3e85dfb3225b4, scope.project.id=ef565d7dde194ab5beaeb9815600c4a4, user.id=ae590453bcf24b44a05cef758b0a5f0e) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:40.247568 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617ac14-a085-4a15-a355-e9447594a9b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:40.250282 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617ac14-a085-4a15-a355-e9447594a9b4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:40.256882 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 51/97] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:55:39 2022] GET /identity/v3/role_assignments?user.id=ae590453bcf24b44a05cef758b0a5f0e&scope.project.id=ef565d7dde194ab5beaeb9815600c4a4&role.id=a4345a1838084e3494c3e85dfb3225b4 => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:41.949169 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b992842-952c-4aea-9e39-3355db902703 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:41.949752 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b992842-952c-4aea-9e39-3355db902703 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:41.949752 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b992842-952c-4aea-9e39-3355db902703 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:41.951873 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 47/98] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:41.957723 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecd464-fff8-437b-a9c7-4c9476fd68fc None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:41.958265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecd464-fff8-437b-a9c7-4c9476fd68fc None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:41.958265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecd464-fff8-437b-a9c7-4c9476fd68fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:41.984378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-44ecd464-fff8-437b-a9c7-4c9476fd68fc None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:41.985609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-44ecd464-fff8-437b-a9c7-4c9476fd68fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:42.062826 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 52/99] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:42.087671 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b992842-952c-4aea-9e39-3355db902703 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:42.219434 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b992842-952c-4aea-9e39-3355db902703 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:42.221249 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:42.258239 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b732ec7-d04a-4842-bce9-3bbedf0c8386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:42.259079 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b732ec7-d04a-4842-bce9-3bbedf0c8386 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:42.259372 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b732ec7-d04a-4842-bce9-3bbedf0c8386 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:42.259653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b732ec7-d04a-4842-bce9-3bbedf0c8386 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:42.260849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b732ec7-d04a-4842-bce9-3bbedf0c8386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:42.262319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b732ec7-d04a-4842-bce9-3bbedf0c8386 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:42.265383 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 48/100] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:55:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:42.270786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecd464-fff8-437b-a9c7-4c9476fd68fc None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:42.293815 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459ab3f-76a1-4c88-ae41-48a56e6ab20e None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:42.294121 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459ab3f-76a1-4c88-ae41-48a56e6ab20e None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:42.294381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459ab3f-76a1-4c88-ae41-48a56e6ab20e None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:42.296635 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 49/101] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:55:42.301701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9133a1-e891-40fa-8a65-5f2649732458 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:42.301999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9133a1-e891-40fa-8a65-5f2649732458 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:42.302279 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9133a1-e891-40fa-8a65-5f2649732458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:42.332936 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-0b9133a1-e891-40fa-8a65-5f2649732458 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:42.334167 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-0b9133a1-e891-40fa-8a65-5f2649732458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:42.379162 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:42.421716 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 50/102] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:55:42.423612 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa4c03-a4c7-45e2-924b-4ab9d7d1720f None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:42.424062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa4c03-a4c7-45e2-924b-4ab9d7d1720f None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:42.424655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa4c03-a4c7-45e2-924b-4ab9d7d1720f None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:42.426401 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 51/103] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:42.432736 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd2817-d50c-42e6-bb8b-5e0b91e38142 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:42.433250 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd2817-d50c-42e6-bb8b-5e0b91e38142 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:42.433732 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd2817-d50c-42e6-bb8b-5e0b91e38142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:42.455923 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-fafd2817-d50c-42e6-bb8b-5e0b91e38142 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:42.457662 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-fafd2817-d50c-42e6-bb8b-5e0b91e38142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:42.487154 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecd464-fff8-437b-a9c7-4c9476fd68fc None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:42.543285 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 52/104] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:55:42.545871 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd2817-d50c-42e6-bb8b-5e0b91e38142 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:42.579561 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfff86c-87e2-4e0c-8d55-1c7233021bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:42.580406 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfff86c-87e2-4e0c-8d55-1c7233021bb7 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:42.580705 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfff86c-87e2-4e0c-8d55-1c7233021bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:42.580990 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfff86c-87e2-4e0c-8d55-1c7233021bb7 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:42.581724 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfff86c-87e2-4e0c-8d55-1c7233021bb7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:42.583409 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfff86c-87e2-4e0c-8d55-1c7233021bb7 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:42.595459 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:42.632411 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 53/105] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Jul 11 11:55:42 2022] POST /identity/v3/projects => generated 302 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:55:42.633374 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfff86c-87e2-4e0c-8d55-1c7233021bb7 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:42.691040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd2817-d50c-42e6-bb8b-5e0b91e38142 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:42.737628 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc93fc0-1071-47ad-bd8e-3c9d41ecb05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:42.738991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc93fc0-1071-47ad-bd8e-3c9d41ecb05c None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:42.739290 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc93fc0-1071-47ad-bd8e-3c9d41ecb05c None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:42.739568 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc93fc0-1071-47ad-bd8e-3c9d41ecb05c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:42.754482 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc93fc0-1071-47ad-bd8e-3c9d41ecb05c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:42.765094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-ecc93fc0-1071-47ad-bd8e-3c9d41ecb05c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:55:42.765094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:42.765094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:42.765094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:42.765094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:42.765094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:42.765094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:42.765094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:42.765094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:42.765094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:42.765094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:42.765094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:42.765094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:42.765094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:42.765094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:42.765094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:42.766069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:42.766069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:42.766069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:42.766069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:42.766069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:42.766069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:42.766069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:42.766069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:42.766069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:42.766069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:42.766069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:42.766069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:42.766069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:42.766069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:42.766069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:42.766069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:42.766902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:42.766902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:42.766902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:42.766902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:42.766902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:42.766902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:42.766902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:42.766902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:42.766902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:42.766902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:42.766902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:55:42.766902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:55:42.766902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 53/106] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:42.768275 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd02a0-b069-401a-ad3c-d6393745b275 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:42.768562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd02a0-b069-401a-ad3c-d6393745b275 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:42.768838 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd02a0-b069-401a-ad3c-d6393745b275 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:42.770411 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 54/107] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:42.778781 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd02a0-b069-401a-ad3c-d6393745b275 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:42.849015 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfff86c-87e2-4e0c-8d55-1c7233021bb7 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:42.873561 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:42.897237 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:42.909737 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d199b-6eb7-4684-a76d-0d78c66135c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:42.910650 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d199b-6eb7-4684-a76d-0d78c66135c4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:42.912068 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d199b-6eb7-4684-a76d-0d78c66135c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:42.912189 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd02a0-b069-401a-ad3c-d6393745b275 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:42.912349 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d199b-6eb7-4684-a76d-0d78c66135c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:42.927149 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d199b-6eb7-4684-a76d-0d78c66135c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:42.936165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-3d5d199b-6eb7-4684-a76d-0d78c66135c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:55:42.936165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:42.936165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:42.936165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:42.936165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:42.936165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:42.936165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:42.936165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:42.936165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:42.936165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:42.936165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:42.936165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:42.936165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:42.936165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:42.936165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:42.936165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:42.937013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:42.937013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:42.937013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:42.937013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:42.937013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:42.937013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:42.937013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:42.937013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:42.937013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:42.937013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:42.937013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:42.937013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:42.937013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:42.937013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:42.937013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:42.937013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:42.937766 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:42.937766 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:42.937766 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:42.937766 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:42.937766 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:42.937766 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:42.937766 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:42.937766 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:42.937766 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:42.937766 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:42.937766 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:55:42.937766 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:55:42.937766 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 54/108] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:55:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:42.938877 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6080921-cabd-4001-943d-56c9eae137cd None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:42.940440 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6080921-cabd-4001-943d-56c9eae137cd None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:42.940440 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6080921-cabd-4001-943d-56c9eae137cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:42.954964 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ec884-289d-4261-906c-bed960ab074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:42.955640 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ec884-289d-4261-906c-bed960ab074e None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:42.955931 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ec884-289d-4261-906c-bed960ab074e None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:42.956250 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ec884-289d-4261-906c-bed960ab074e None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:42.957054 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ec884-289d-4261-906c-bed960ab074e None admin] RBAC: Adding query filter params (name=member) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:42.957266 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-f6080921-cabd-4001-943d-56c9eae137cd None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:42.957437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ec884-289d-4261-906c-bed960ab074e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:42.958632 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f6080921-cabd-4001-943d-56c9eae137cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:42.959100 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ec884-289d-4261-906c-bed960ab074e None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:42.972519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 55/109] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:55:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:42.973435 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ec884-289d-4261-906c-bed960ab074e None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:43.044178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 55/110] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:43.045302 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6080921-cabd-4001-943d-56c9eae137cd None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:43.116909 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ec884-289d-4261-906c-bed960ab074e None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:43.159270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72295ecf-9e0c-4e07-ae9d-01c1944109e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:43.160100 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72295ecf-9e0c-4e07-ae9d-01c1944109e1 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:43.160386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72295ecf-9e0c-4e07-ae9d-01c1944109e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:43.160664 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72295ecf-9e0c-4e07-ae9d-01c1944109e1 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:43.161420 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72295ecf-9e0c-4e07-ae9d-01c1944109e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:43.161730 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72295ecf-9e0c-4e07-ae9d-01c1944109e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:43.163370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72295ecf-9e0c-4e07-ae9d-01c1944109e1 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:43.178819 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 56/111] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:55:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:43.179918 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72295ecf-9e0c-4e07-ae9d-01c1944109e1 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:43.199077 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:43.202190 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:43.204538 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6080921-cabd-4001-943d-56c9eae137cd None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:43.246555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd34f7a-2f0b-4536-9628-b42e928cd1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:43.247504 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd34f7a-2f0b-4536-9628-b42e928cd1b8 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:43.247793 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd34f7a-2f0b-4536-9628-b42e928cd1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:43.248445 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd34f7a-2f0b-4536-9628-b42e928cd1b8 None admin] PATH_INFO: `/v3/users/ae590453bcf24b44a05cef758b0a5f0e` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:43.249501 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd34f7a-2f0b-4536-9628-b42e928cd1b8 None admin] RBAC: Authorizing `identity:get_user(user_id=ae590453bcf24b44a05cef758b0a5f0e)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:43.251215 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd34f7a-2f0b-4536-9628-b42e928cd1b8 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:43.253292 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 56/112] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:43 2022] GET /identity/v3/users/ae590453bcf24b44a05cef758b0a5f0e => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:43.253950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd34f7a-2f0b-4536-9628-b42e928cd1b8 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:43.365564 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd34f7a-2f0b-4536-9628-b42e928cd1b8 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:43.386197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72295ecf-9e0c-4e07-ae9d-01c1944109e1 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:43.407732 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801742a-66d2-4f45-9314-74fc5118e5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:43.408613 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801742a-66d2-4f45-9314-74fc5118e5f2 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:43.408898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801742a-66d2-4f45-9314-74fc5118e5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:43.409178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801742a-66d2-4f45-9314-74fc5118e5f2 None admin] PATH_INFO: `/v3/users/ae590453bcf24b44a05cef758b0a5f0e` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:43.410503 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801742a-66d2-4f45-9314-74fc5118e5f2 None admin] RBAC: Authorizing `identity:get_user(user_id=ae590453bcf24b44a05cef758b0a5f0e)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:43.412110 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801742a-66d2-4f45-9314-74fc5118e5f2 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:43.413921 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 57/113] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:43 2022] GET /identity/v3/users/ae590453bcf24b44a05cef758b0a5f0e => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:43.414503 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801742a-66d2-4f45-9314-74fc5118e5f2 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:43.454756 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:43.492023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8801f3-4df0-48ea-9de6-84330b31739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:43.493216 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8801f3-4df0-48ea-9de6-84330b31739f None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:43.493713 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8801f3-4df0-48ea-9de6-84330b31739f None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:43.494205 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8801f3-4df0-48ea-9de6-84330b31739f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:43.527680 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8801f3-4df0-48ea-9de6-84330b31739f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:43.527886 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801742a-66d2-4f45-9314-74fc5118e5f2 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:43.535850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-3c8801f3-4df0-48ea-9de6-84330b31739f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:55:43.535850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:43.535850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:43.535850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:43.535850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:43.535850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:43.535850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:43.535850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:43.535850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:43.535850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:43.535850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:43.535850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:43.535850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:43.535850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:43.535850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:43.535850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:43.536733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:43.536733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:43.536733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:43.536733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:43.536733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:43.536733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:43.536733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:43.536733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:43.536733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:43.536733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:43.536733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:43.536733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:43.536733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:43.536733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:43.536733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:43.536733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:43.537529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:43.537529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:43.537529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:43.537529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:43.537529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:43.537529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:43.537529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:43.537529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:43.537529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:43.537529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:43.537529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:55:43.537529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:55:43.537529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 57/114] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:43.538152 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8801f3-4df0-48ea-9de6-84330b31739f None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:43.577127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f44aa-df84-4714-848c-2c83996d4468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:43.577991 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f44aa-df84-4714-848c-2c83996d4468 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:43.578274 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f44aa-df84-4714-848c-2c83996d4468 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:43.578550 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f44aa-df84-4714-848c-2c83996d4468 None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:43.579781 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f44aa-df84-4714-848c-2c83996d4468 None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:43.581246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f44aa-df84-4714-848c-2c83996d4468 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:43.583142 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 58/115] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:43 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:43.584253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194ca78-deec-4480-9d92-31a7b21cc408 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:43.584545 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194ca78-deec-4480-9d92-31a7b21cc408 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:43.584822 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194ca78-deec-4480-9d92-31a7b21cc408 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:43.586050 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 59/116] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:43.586781 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194ca78-deec-4480-9d92-31a7b21cc408 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:43.648219 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:43.675642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8801f3-4df0-48ea-9de6-84330b31739f None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:43.698830 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194ca78-deec-4480-9d92-31a7b21cc408 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:43.702070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:43.712265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6979833-6697-440a-a6e3-8ea54769f6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:43.713333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6979833-6697-440a-a6e3-8ea54769f6dc None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:43.713628 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6979833-6697-440a-a6e3-8ea54769f6dc None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:43.713911 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6979833-6697-440a-a6e3-8ea54769f6dc None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:43.715149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6979833-6697-440a-a6e3-8ea54769f6dc None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:43.717015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6979833-6697-440a-a6e3-8ea54769f6dc None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:43.723127 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 58/117] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:43 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:43.723991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6979833-6697-440a-a6e3-8ea54769f6dc None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:43.737945 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142eeda-1a07-46ae-83d2-f602d93a7c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:43.738678 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142eeda-1a07-46ae-83d2-f602d93a7c0e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:43.738997 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142eeda-1a07-46ae-83d2-f602d93a7c0e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:43.739279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142eeda-1a07-46ae-83d2-f602d93a7c0e None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:43.740036 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142eeda-1a07-46ae-83d2-f602d93a7c0e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:43.740345 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142eeda-1a07-46ae-83d2-f602d93a7c0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:43.741824 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142eeda-1a07-46ae-83d2-f602d93a7c0e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:43.752604 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 60/118] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:55:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:43.753948 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de10ff5-d13b-4438-ac48-dccd883239bf None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:43.759236 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de10ff5-d13b-4438-ac48-dccd883239bf None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:43.759618 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de10ff5-d13b-4438-ac48-dccd883239bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:43.778191 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-6de10ff5-d13b-4438-ac48-dccd883239bf None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:43.779628 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6de10ff5-d13b-4438-ac48-dccd883239bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:43.834978 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6979833-6697-440a-a6e3-8ea54769f6dc None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:43.851665 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 61/119] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:43.852644 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de10ff5-d13b-4438-ac48-dccd883239bf None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:43.887279 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7318a9b-970f-48fd-976d-c180f0752dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:43.888716 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7318a9b-970f-48fd-976d-c180f0752dc5 None admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:43.889098 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7318a9b-970f-48fd-976d-c180f0752dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:43.889098 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7318a9b-970f-48fd-976d-c180f0752dc5 None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d/users/ae590453bcf24b44a05cef758b0a5f0e/roles/a4345a1838084e3494c3e85dfb3225b4` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:43.899616 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7318a9b-970f-48fd-976d-c180f0752dc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2bf11410fd84f91989477a0c73ba52d, user_id=ae590453bcf24b44a05cef758b0a5f0e, role_id=a4345a1838084e3494c3e85dfb3225b4)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:43.901060 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7318a9b-970f-48fd-976d-c180f0752dc5 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:43.916696 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 59/120] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Jul 11 11:55:43 2022] PUT /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d/users/ae590453bcf24b44a05cef758b0a5f0e/roles/a4345a1838084e3494c3e85dfb3225b4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:55:43.917548 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7318a9b-970f-48fd-976d-c180f0752dc5 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:43.921654 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:43.956028 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:43.962531 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de10ff5-d13b-4438-ac48-dccd883239bf None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:44.002014 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d183d-4486-4fdb-9d88-ee75fbf97aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:44.003210 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d183d-4486-4fdb-9d88-ee75fbf97aa9 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:44.003592 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d183d-4486-4fdb-9d88-ee75fbf97aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:44.003971 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d183d-4486-4fdb-9d88-ee75fbf97aa9 None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d/users/ae590453bcf24b44a05cef758b0a5f0e/roles/7b0becbc0d8a464b83a0b90da1e48a67` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:44.006552 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d183d-4486-4fdb-9d88-ee75fbf97aa9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2bf11410fd84f91989477a0c73ba52d, user_id=ae590453bcf24b44a05cef758b0a5f0e, role_id=7b0becbc0d8a464b83a0b90da1e48a67)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:44.008188 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d183d-4486-4fdb-9d88-ee75fbf97aa9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:44.024869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 62/121] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Jul 11 11:55:43 2022] PUT /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d/users/ae590453bcf24b44a05cef758b0a5f0e/roles/7b0becbc0d8a464b83a0b90da1e48a67 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:55:44.026055 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d183d-4486-4fdb-9d88-ee75fbf97aa9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:44.074269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7318a9b-970f-48fd-976d-c180f0752dc5 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:44.131120 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ab60d-f94c-468f-b880-0e165833aba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:44.132055 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ab60d-f94c-468f-b880-0e165833aba1 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:44.132341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ab60d-f94c-468f-b880-0e165833aba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:44.132616 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ab60d-f94c-468f-b880-0e165833aba1 None admin] PATH_INFO: `/v3/users/5ec211c517a6449e85af812a120e92da` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:44.150927 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ab60d-f94c-468f-b880-0e165833aba1 None admin] RBAC: Authorizing `identity:get_user(user_id=5ec211c517a6449e85af812a120e92da)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:44.152650 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ab60d-f94c-468f-b880-0e165833aba1 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:44.152849 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d183d-4486-4fdb-9d88-ee75fbf97aa9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:44.155609 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 60/122] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:43 2022] GET /identity/v3/users/5ec211c517a6449e85af812a120e92da => generated 289 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:44.157153 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1e099-4e31-48f3-a725-b9a0e52ac2ed None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:44.157445 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1e099-4e31-48f3-a725-b9a0e52ac2ed None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:44.157722 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1e099-4e31-48f3-a725-b9a0e52ac2ed None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:44.159412 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 61/123] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:44.165297 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a94f7-757a-4f73-a89b-21d5ecfaccad None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:44.165593 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a94f7-757a-4f73-a89b-21d5ecfaccad None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:44.165871 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a94f7-757a-4f73-a89b-21d5ecfaccad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:44.190936 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-773a94f7-757a-4f73-a89b-21d5ecfaccad None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:44.192193 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-773a94f7-757a-4f73-a89b-21d5ecfaccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:44.208071 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821c981-d440-4330-95c2-0da21f24a12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:44.210682 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821c981-d440-4330-95c2-0da21f24a12b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:44.211261 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821c981-d440-4330-95c2-0da21f24a12b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:44.211747 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821c981-d440-4330-95c2-0da21f24a12b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:44.225273 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821c981-d440-4330-95c2-0da21f24a12b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:44.235000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-4821c981-d440-4330-95c2-0da21f24a12b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:55:44.235000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:44.235000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:44.235000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:44.235000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:44.235000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:44.235000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:44.235000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:44.235000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:44.235000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:44.235000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:44.235000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:44.235000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:44.235000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:44.235000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:44.235000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:44.235913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:44.235913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:44.235913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:44.235913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:44.235913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:44.235913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:44.235913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:44.235913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:44.235913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:44.235913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:44.235913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:44.235913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:44.235913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:44.235913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:44.235913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:44.235913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:44.236646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:44.236646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:44.236646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:44.236646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:44.236646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:44.236646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:44.236646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:44.236646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:44.236646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:44.236646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:44.236646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:55:44.236646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:55:44.239478 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 63/124] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:44.240587 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821c981-d440-4330-95c2-0da21f24a12b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:44.261560 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:44.268032 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:44.287545 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 62/125] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:44.289557 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a94f7-757a-4f73-a89b-21d5ecfaccad None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:44.379897 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821c981-d440-4330-95c2-0da21f24a12b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:44.418056 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b86dca-eacd-46e4-83e6-8d5b128796ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:44.419099 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b86dca-eacd-46e4-83e6-8d5b128796ae None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:44.420268 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b86dca-eacd-46e4-83e6-8d5b128796ae None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:44.420749 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b86dca-eacd-46e4-83e6-8d5b128796ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:44.452986 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a94f7-757a-4f73-a89b-21d5ecfaccad None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:44.499497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9811db-befe-40be-a4ab-371cbbae0158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:44.500405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9811db-befe-40be-a4ab-371cbbae0158 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:44.500693 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9811db-befe-40be-a4ab-371cbbae0158 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:44.500973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9811db-befe-40be-a4ab-371cbbae0158 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:44.502143 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9811db-befe-40be-a4ab-371cbbae0158 None admin] RBAC: Adding query filter params (name=member) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:44.502456 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9811db-befe-40be-a4ab-371cbbae0158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:44.504463 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9811db-befe-40be-a4ab-371cbbae0158 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:44.512938 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b86dca-eacd-46e4-83e6-8d5b128796ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:44.515597 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 63/126] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:55:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:44.515887 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b86dca-eacd-46e4-83e6-8d5b128796ae None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:44.516427 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9811db-befe-40be-a4ab-371cbbae0158 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:44.540622 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:44.588013 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:44.632984 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 64/127] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:55:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:55:44.638735 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b86dca-eacd-46e4-83e6-8d5b128796ae None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:44.646449 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9811db-befe-40be-a4ab-371cbbae0158 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:44.713321 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01caa85-efd9-4821-b03a-5fcc99ab6564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:44.714045 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01caa85-efd9-4821-b03a-5fcc99ab6564 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:44.714401 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01caa85-efd9-4821-b03a-5fcc99ab6564 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:44.714659 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01caa85-efd9-4821-b03a-5fcc99ab6564 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:44.730156 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01caa85-efd9-4821-b03a-5fcc99ab6564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:44.739116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-b01caa85-efd9-4821-b03a-5fcc99ab6564 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:55:44.739116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:44.739116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:44.739116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:44.739116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:44.739116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:44.739116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:44.739116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:44.739116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:44.739116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:44.739116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:44.739116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:44.739116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:44.739116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:44.739116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:44.739116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:44.739992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:44.739992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:44.739992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:44.739992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:44.739992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:44.739992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:44.739992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:44.739992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:44.739992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:44.739992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:44.739992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:44.739992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:44.739992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:44.739992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:44.739992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:44.739992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:44.740746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:44.740746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:44.740746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:44.740746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:44.740746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:44.740746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:44.740746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:44.740746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:44.740746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:44.740746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:44.740746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:55:44.740746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:55:44.740746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 64/128] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:55:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:44.741390 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01caa85-efd9-4821-b03a-5fcc99ab6564 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:44.761073 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b86dca-eacd-46e4-83e6-8d5b128796ae None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:44.786735 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:44.818827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf96071-b46b-4b37-a08b-91bedd81ff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:44.820098 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf96071-b46b-4b37-a08b-91bedd81ff68 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:44.820617 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf96071-b46b-4b37-a08b-91bedd81ff68 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:44.821113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf96071-b46b-4b37-a08b-91bedd81ff68 None admin] PATH_INFO: `/v3/users/ae590453bcf24b44a05cef758b0a5f0e` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:44.822576 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf96071-b46b-4b37-a08b-91bedd81ff68 None admin] RBAC: Authorizing `identity:get_user(user_id=ae590453bcf24b44a05cef758b0a5f0e)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:44.824280 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf96071-b46b-4b37-a08b-91bedd81ff68 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:44.826677 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 65/129] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:44 2022] GET /identity/v3/users/ae590453bcf24b44a05cef758b0a5f0e => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:44.833156 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf96071-b46b-4b37-a08b-91bedd81ff68 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:44.887487 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01caa85-efd9-4821-b03a-5fcc99ab6564 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:44.919162 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:44.964397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8574189-aa48-4add-95a0-7999c148d4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:44.966853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8574189-aa48-4add-95a0-7999c148d4a5 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:44.967395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8574189-aa48-4add-95a0-7999c148d4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:44.967890 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8574189-aa48-4add-95a0-7999c148d4a5 None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:44.972350 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8574189-aa48-4add-95a0-7999c148d4a5 None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:44.974072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8574189-aa48-4add-95a0-7999c148d4a5 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:44.977091 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 65/130] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:44 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:44.978167 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8574189-aa48-4add-95a0-7999c148d4a5 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:44.987579 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf96071-b46b-4b37-a08b-91bedd81ff68 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:45.035783 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678aa75-164a-41ad-a850-65de0b4a50d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:45.036837 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678aa75-164a-41ad-a850-65de0b4a50d5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:45.037324 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678aa75-164a-41ad-a850-65de0b4a50d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:45.037818 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678aa75-164a-41ad-a850-65de0b4a50d5 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:45.038941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678aa75-164a-41ad-a850-65de0b4a50d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:45.039671 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678aa75-164a-41ad-a850-65de0b4a50d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:45.041276 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678aa75-164a-41ad-a850-65de0b4a50d5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:45.050651 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 66/131] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:45.051771 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678aa75-164a-41ad-a850-65de0b4a50d5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:45.119620 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:45.188722 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678aa75-164a-41ad-a850-65de0b4a50d5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:45.221069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8574189-aa48-4add-95a0-7999c148d4a5 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:45.225622 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464838f4-6626-4744-8b53-042f593bc53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:45.226531 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464838f4-6626-4744-8b53-042f593bc53c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:45.227038 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464838f4-6626-4744-8b53-042f593bc53c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:45.227511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464838f4-6626-4744-8b53-042f593bc53c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:45.228550 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464838f4-6626-4744-8b53-042f593bc53c None admin] RBAC: Adding query filter params (role.id=e31991ec4dc346aca330fca5d28c258f, scope.project.id=d2bf11410fd84f91989477a0c73ba52d, user.id=5ec211c517a6449e85af812a120e92da) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:45.229327 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464838f4-6626-4744-8b53-042f593bc53c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:45.231028 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464838f4-6626-4744-8b53-042f593bc53c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:45.238692 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 67/132] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:55:45 2022] GET /identity/v3/role_assignments?user.id=5ec211c517a6449e85af812a120e92da&scope.project.id=d2bf11410fd84f91989477a0c73ba52d&role.id=e31991ec4dc346aca330fca5d28c258f => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:45.244020 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464838f4-6626-4744-8b53-042f593bc53c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:45.363472 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8544b4-0a38-4fbf-8956-c9dc27372abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:45.364430 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8544b4-0a38-4fbf-8956-c9dc27372abf None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:45.364904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8544b4-0a38-4fbf-8956-c9dc27372abf None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:45.365343 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8544b4-0a38-4fbf-8956-c9dc27372abf None admin] PATH_INFO: `/v3/projects/ef565d7dde194ab5beaeb9815600c4a4` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:45.369278 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8544b4-0a38-4fbf-8956-c9dc27372abf None admin] RBAC: Authorizing `identity:get_project(project_id=ef565d7dde194ab5beaeb9815600c4a4)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:45.371053 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8544b4-0a38-4fbf-8956-c9dc27372abf None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:45.373255 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 66/133] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:44 2022] GET /identity/v3/projects/ef565d7dde194ab5beaeb9815600c4a4 => generated 312 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:45.379169 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8544b4-0a38-4fbf-8956-c9dc27372abf None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:45.389079 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464838f4-6626-4744-8b53-042f593bc53c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:45.408922 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:45.427829 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d4568-4f3d-43e1-8f46-e615996884f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:45.429255 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d4568-4f3d-43e1-8f46-e615996884f3 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:45.429776 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d4568-4f3d-43e1-8f46-e615996884f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:45.430740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d4568-4f3d-43e1-8f46-e615996884f3 None admin] PATH_INFO: `/v3/users/df8711dbef0e4322ab4112544df903c1` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:45.432644 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d4568-4f3d-43e1-8f46-e615996884f3 None admin] RBAC: Authorizing `identity:get_user(user_id=df8711dbef0e4322ab4112544df903c1)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:45.434677 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d4568-4f3d-43e1-8f46-e615996884f3 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:45.437555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 68/134] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:45 2022] GET /identity/v3/users/df8711dbef0e4322ab4112544df903c1 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:45.443686 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d4568-4f3d-43e1-8f46-e615996884f3 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:45.464458 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:45.523766 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8544b4-0a38-4fbf-8956-c9dc27372abf None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:45.568213 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c460c-3042-489a-a1dd-943566906567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:45.569524 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c460c-3042-489a-a1dd-943566906567 None admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:45.570061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c460c-3042-489a-a1dd-943566906567 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:45.570484 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c460c-3042-489a-a1dd-943566906567 None admin] PATH_INFO: `/v3/projects/ef565d7dde194ab5beaeb9815600c4a4/users/ae590453bcf24b44a05cef758b0a5f0e/roles/a4345a1838084e3494c3e85dfb3225b4` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:45.573009 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c460c-3042-489a-a1dd-943566906567 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef565d7dde194ab5beaeb9815600c4a4, user_id=ae590453bcf24b44a05cef758b0a5f0e, role_id=a4345a1838084e3494c3e85dfb3225b4)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:45.574660 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c460c-3042-489a-a1dd-943566906567 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:45.592445 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 67/135] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Jul 11 11:55:45 2022] PUT /identity/v3/projects/ef565d7dde194ab5beaeb9815600c4a4/users/ae590453bcf24b44a05cef758b0a5f0e/roles/a4345a1838084e3494c3e85dfb3225b4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:55:45.653290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d4568-4f3d-43e1-8f46-e615996884f3 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:45.702269 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e9e88-4c0f-4f8a-89bf-62669a50db90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:45.703197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9e88-4c0f-4f8a-89bf-62669a50db90 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:45.703486 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9e88-4c0f-4f8a-89bf-62669a50db90 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:45.703763 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9e88-4c0f-4f8a-89bf-62669a50db90 None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:45.705048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e9e88-4c0f-4f8a-89bf-62669a50db90 None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:45.706547 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e9e88-4c0f-4f8a-89bf-62669a50db90 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:45.708581 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 69/136] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:45 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:45.715923 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c460c-3042-489a-a1dd-943566906567 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:45.859275 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c460c-3042-489a-a1dd-943566906567 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:45.869882 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:45.897930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c13b3-7fd0-43a3-9043-e3c22bfa6195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:45.899232 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c13b3-7fd0-43a3-9043-e3c22bfa6195 None admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:45.899723 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c13b3-7fd0-43a3-9043-e3c22bfa6195 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:45.900218 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c13b3-7fd0-43a3-9043-e3c22bfa6195 None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d/users/df8711dbef0e4322ab4112544df903c1/roles/11fc9dc7c3664b2b8af8eee2462707b8` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:45.902552 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c13b3-7fd0-43a3-9043-e3c22bfa6195 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2bf11410fd84f91989477a0c73ba52d, user_id=df8711dbef0e4322ab4112544df903c1, role_id=11fc9dc7c3664b2b8af8eee2462707b8)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:45.904830 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c13b3-7fd0-43a3-9043-e3c22bfa6195 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:45.921470 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 68/137] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Jul 11 11:55:45 2022] PUT /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d/users/df8711dbef0e4322ab4112544df903c1/roles/11fc9dc7c3664b2b8af8eee2462707b8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:55:46.022137 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ac110-018d-4ff1-8628-685b379acf1d None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:46.023177 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ac110-018d-4ff1-8628-685b379acf1d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:46.023714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ac110-018d-4ff1-8628-685b379acf1d None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:46.025322 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 70/138] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:46.032007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6d1e2-797f-4f8a-b1d0-b157073a300c None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:46.032629 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6d1e2-797f-4f8a-b1d0-b157073a300c None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:46.033171 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6d1e2-797f-4f8a-b1d0-b157073a300c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:46.052203 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-bab6d1e2-797f-4f8a-b1d0-b157073a300c None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:46.053888 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-bab6d1e2-797f-4f8a-b1d0-b157073a300c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:46.130000 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 69/139] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:46.157069 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ac110-018d-4ff1-8628-685b379acf1d None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:46.233057 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:46.306042 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ac110-018d-4ff1-8628-685b379acf1d None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:46.345652 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2798d53-65f2-4dc8-8e54-2a5583130629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:46.346838 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2798d53-65f2-4dc8-8e54-2a5583130629 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:46.347378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2798d53-65f2-4dc8-8e54-2a5583130629 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:46.347869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2798d53-65f2-4dc8-8e54-2a5583130629 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:46.349760 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2798d53-65f2-4dc8-8e54-2a5583130629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:46.351573 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2798d53-65f2-4dc8-8e54-2a5583130629 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:46.353430 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 71/140] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:55:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:46.361300 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6d1e2-797f-4f8a-b1d0-b157073a300c None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:46.492020 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:46.495643 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6d1e2-797f-4f8a-b1d0-b157073a300c None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:46.549418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d4016-9a20-4dc2-aaae-aee8fe6aad13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:46.550112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d4016-9a20-4dc2-aaae-aee8fe6aad13 None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:46.550404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d4016-9a20-4dc2-aaae-aee8fe6aad13 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:46.550689 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d4016-9a20-4dc2-aaae-aee8fe6aad13 None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:46.551432 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d4016-9a20-4dc2-aaae-aee8fe6aad13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:46.552899 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d4016-9a20-4dc2-aaae-aee8fe6aad13 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:46.599481 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 70/141] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Jul 11 11:55:46 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:55:47.058073 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcdeb2-952f-425c-9aa7-a215e14cb7c8 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:47.058600 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcdeb2-952f-425c-9aa7-a215e14cb7c8 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:47.058693 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcdeb2-952f-425c-9aa7-a215e14cb7c8 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:47.060210 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 72/142] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:47.065550 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa654bbd-669e-43a4-836c-3bfa9fdf2815 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:47.065846 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa654bbd-669e-43a4-836c-3bfa9fdf2815 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:47.066128 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa654bbd-669e-43a4-836c-3bfa9fdf2815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:47.087207 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-aa654bbd-669e-43a4-836c-3bfa9fdf2815 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:47.088387 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-aa654bbd-669e-43a4-836c-3bfa9fdf2815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:47.170852 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 71/143] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:47.221840 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcdeb2-952f-425c-9aa7-a215e14cb7c8 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:47.370186 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcdeb2-952f-425c-9aa7-a215e14cb7c8 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:47.390052 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:47.422405 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148c325-d0b0-4d0c-b8e4-73858659afb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:47.423241 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148c325-d0b0-4d0c-b8e4-73858659afb7 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:47.423527 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148c325-d0b0-4d0c-b8e4-73858659afb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:47.423806 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148c325-d0b0-4d0c-b8e4-73858659afb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:47.440491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148c325-d0b0-4d0c-b8e4-73858659afb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:47.448196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-b148c325-d0b0-4d0c-b8e4-73858659afb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:55:47.448196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:47.448196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:47.448196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:47.448196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:47.448196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:47.448196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:47.448196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:47.448196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:47.448196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:47.448196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:47.448196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:47.448196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:47.448196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:47.448196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:47.448196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:47.449026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:47.449026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:47.449026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:47.449026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:47.449026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:47.449026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:47.449026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:47.449026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:47.449026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:47.449026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:47.449026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:47.449026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:47.449026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:47.449026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:47.449026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:47.449026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:47.449773 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:47.449773 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:47.449773 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:47.449773 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:47.449773 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:47.449773 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:47.449773 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:47.449773 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:47.449773 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:47.449773 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:47.449773 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:55:47.449773 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:55:47.449773 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 73/144] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:47.457629 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa654bbd-669e-43a4-836c-3bfa9fdf2815 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:47.475471 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb0763-4c59-4a11-811e-b8edfd6e24aa None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:47.475775 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb0763-4c59-4a11-811e-b8edfd6e24aa None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:47.476039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb0763-4c59-4a11-811e-b8edfd6e24aa None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:47.477671 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 74/145] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:47.483672 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eedcc-cf39-445a-85ed-a10616f96c46 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:47.483958 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eedcc-cf39-445a-85ed-a10616f96c46 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:47.484235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eedcc-cf39-445a-85ed-a10616f96c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:47.509969 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-823eedcc-cf39-445a-85ed-a10616f96c46 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:47.512076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-823eedcc-cf39-445a-85ed-a10616f96c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:47.629897 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:47.642912 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 75/146] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:55:47.651143 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa654bbd-669e-43a4-836c-3bfa9fdf2815 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:47.688581 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32dd3d-f665-4ecd-8d96-1f41e10ea935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:47.689266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32dd3d-f665-4ecd-8d96-1f41e10ea935 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:47.689556 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32dd3d-f665-4ecd-8d96-1f41e10ea935 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:47.689839 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32dd3d-f665-4ecd-8d96-1f41e10ea935 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:47.690606 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32dd3d-f665-4ecd-8d96-1f41e10ea935 None admin] RBAC: Adding query filter params (name=member) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:47.690948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32dd3d-f665-4ecd-8d96-1f41e10ea935 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:47.692355 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32dd3d-f665-4ecd-8d96-1f41e10ea935 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:47.703246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823eedcc-cf39-445a-85ed-a10616f96c46 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:47.714135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 72/147] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:55:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:47.720915 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32dd3d-f665-4ecd-8d96-1f41e10ea935 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:47.818155 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823eedcc-cf39-445a-85ed-a10616f96c46 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:47.832094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32dd3d-f665-4ecd-8d96-1f41e10ea935 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:47.834417 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:47.863211 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0caaf9f-e6d8-439d-a856-0a39b8d9ce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:47.864384 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0caaf9f-e6d8-439d-a856-0a39b8d9ce4a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:47.864863 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0caaf9f-e6d8-439d-a856-0a39b8d9ce4a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:47.865463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0caaf9f-e6d8-439d-a856-0a39b8d9ce4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:47.876518 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292c67f-a25e-43d1-9c5b-c69a0aff7004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:47.877613 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292c67f-a25e-43d1-9c5b-c69a0aff7004 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:47.878070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292c67f-a25e-43d1-9c5b-c69a0aff7004 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:47.878493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292c67f-a25e-43d1-9c5b-c69a0aff7004 None admin] PATH_INFO: `/v3/users/ae590453bcf24b44a05cef758b0a5f0e` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:47.879977 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292c67f-a25e-43d1-9c5b-c69a0aff7004 None admin] RBAC: Authorizing `identity:get_user(user_id=ae590453bcf24b44a05cef758b0a5f0e)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:47.880484 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0caaf9f-e6d8-439d-a856-0a39b8d9ce4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:47.881730 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292c67f-a25e-43d1-9c5b-c69a0aff7004 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:47.883936 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 73/148] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:47 2022] GET /identity/v3/users/ae590453bcf24b44a05cef758b0a5f0e => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:47.890283 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292c67f-a25e-43d1-9c5b-c69a0aff7004 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:47.890827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-a0caaf9f-e6d8-439d-a856-0a39b8d9ce4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:55:47.890827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:47.890827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:47.890827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:47.890827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:47.890827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:47.890827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:47.890827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:47.890827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:47.890827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:47.890827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:47.890827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:47.890827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:47.890827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:47.890827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:47.890827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:47.891679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:47.891679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:47.891679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:47.891679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:47.891679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:47.891679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:47.891679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:47.891679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:47.891679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:47.891679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:47.891679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:47.891679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:47.891679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:47.891679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:47.891679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:47.891679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:47.892434 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:47.892434 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:47.892434 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:47.892434 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:47.892434 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:47.892434 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:47.892434 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:47.892434 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:47.892434 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:47.892434 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:47.892434 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:55:47.892434 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:55:47.894912 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 76/149] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:55:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:55:47.905064 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0caaf9f-e6d8-439d-a856-0a39b8d9ce4a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:47.909917 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:48.011214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292c67f-a25e-43d1-9c5b-c69a0aff7004 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:48.030143 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0caaf9f-e6d8-439d-a856-0a39b8d9ce4a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:48.083923 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c773540-a878-491a-ba7a-dd41edfab581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:48.084939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c773540-a878-491a-ba7a-dd41edfab581 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:48.085446 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c773540-a878-491a-ba7a-dd41edfab581 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:48.085932 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c773540-a878-491a-ba7a-dd41edfab581 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:48.106600 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a970cb-f442-4a47-a0b8-c15619657c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:48.108717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a970cb-f442-4a47-a0b8-c15619657c8c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:48.109201 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a970cb-f442-4a47-a0b8-c15619657c8c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:48.109690 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a970cb-f442-4a47-a0b8-c15619657c8c None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:48.110644 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a970cb-f442-4a47-a0b8-c15619657c8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:48.111417 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a970cb-f442-4a47-a0b8-c15619657c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:48.113765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a970cb-f442-4a47-a0b8-c15619657c8c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:48.129388 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 77/150] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:55:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:48.139395 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a970cb-f442-4a47-a0b8-c15619657c8c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:48.211084 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:48.223012 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c773540-a878-491a-ba7a-dd41edfab581 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:48.225028 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c773540-a878-491a-ba7a-dd41edfab581 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:48.245485 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:48.314601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a970cb-f442-4a47-a0b8-c15619657c8c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:48.353861 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d2f4a-99f9-4260-aba4-123dbdf2a0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:48.355410 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d2f4a-99f9-4260-aba4-123dbdf2a0ad None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:48.355926 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d2f4a-99f9-4260-aba4-123dbdf2a0ad None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:48.356393 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d2f4a-99f9-4260-aba4-123dbdf2a0ad None admin] PATH_INFO: `/v3/users/ae590453bcf24b44a05cef758b0a5f0e` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:48.358697 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d2f4a-99f9-4260-aba4-123dbdf2a0ad None admin] RBAC: Authorizing `identity:get_user(user_id=ae590453bcf24b44a05cef758b0a5f0e)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:48.360398 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d2f4a-99f9-4260-aba4-123dbdf2a0ad None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:48.362261 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 78/151] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:48 2022] GET /identity/v3/users/ae590453bcf24b44a05cef758b0a5f0e => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:48.367680 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d2f4a-99f9-4260-aba4-123dbdf2a0ad None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:48.384844 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 74/152] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:55:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:55:48.390819 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c773540-a878-491a-ba7a-dd41edfab581 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:48.540394 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:48.550860 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d2f4a-99f9-4260-aba4-123dbdf2a0ad None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:48.557158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c773540-a878-491a-ba7a-dd41edfab581 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:48.581674 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:48.627160 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4b51d-8150-40f0-b90e-a07fd0a75712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:48.627660 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da0a12-e455-4a0e-98d7-f3d28522f64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:48.628319 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da0a12-e455-4a0e-98d7-f3d28522f64d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:48.628601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da0a12-e455-4a0e-98d7-f3d28522f64d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:48.628875 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da0a12-e455-4a0e-98d7-f3d28522f64d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:48.629259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4b51d-8150-40f0-b90e-a07fd0a75712 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:48.629743 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4b51d-8150-40f0-b90e-a07fd0a75712 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:48.630208 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4b51d-8150-40f0-b90e-a07fd0a75712 None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:48.632981 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4b51d-8150-40f0-b90e-a07fd0a75712 None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:48.634663 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4b51d-8150-40f0-b90e-a07fd0a75712 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:48.636739 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 75/153] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:48 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:48.643949 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4b51d-8150-40f0-b90e-a07fd0a75712 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:48.819839 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da0a12-e455-4a0e-98d7-f3d28522f64d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:48.821346 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da0a12-e455-4a0e-98d7-f3d28522f64d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:48.838747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4b51d-8150-40f0-b90e-a07fd0a75712 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:48.912936 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f25c6-8665-4cf1-bc2e-a0cf91150c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:48.913851 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f25c6-8665-4cf1-bc2e-a0cf91150c4c None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:48.914273 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f25c6-8665-4cf1-bc2e-a0cf91150c4c None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:48.914672 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f25c6-8665-4cf1-bc2e-a0cf91150c4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:48.915654 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f25c6-8665-4cf1-bc2e-a0cf91150c4c None admin] RBAC: Adding query filter params (role.id=a4345a1838084e3494c3e85dfb3225b4, scope.project.id=d2bf11410fd84f91989477a0c73ba52d, user.id=ae590453bcf24b44a05cef758b0a5f0e) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:48.916100 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f25c6-8665-4cf1-bc2e-a0cf91150c4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:48.917754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f25c6-8665-4cf1-bc2e-a0cf91150c4c None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:48.928794 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 76/154] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:55:48 2022] GET /identity/v3/role_assignments?user.id=ae590453bcf24b44a05cef758b0a5f0e&scope.project.id=d2bf11410fd84f91989477a0c73ba52d&role.id=a4345a1838084e3494c3e85dfb3225b4 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:48.997842 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:49.011052 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 79/155] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:55:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 11:55:49.012764 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f25c6-8665-4cf1-bc2e-a0cf91150c4c None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:49.072497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:49.147548 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f25c6-8665-4cf1-bc2e-a0cf91150c4c None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:49.209047 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7a314-4871-4884-bbe9-f85421b4699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:49.214737 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7a314-4871-4884-bbe9-f85421b4699a None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:49.214737 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7a314-4871-4884-bbe9-f85421b4699a None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:49.214737 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7a314-4871-4884-bbe9-f85421b4699a None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:49.214737 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7a314-4871-4884-bbe9-f85421b4699a None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:49.214737 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7a314-4871-4884-bbe9-f85421b4699a None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:49.215258 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 77/156] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:49 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:49.222363 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da0a12-e455-4a0e-98d7-f3d28522f64d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:49.349686 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79206c-3cc1-4770-8126-0788c541f7a7 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:49.350029 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79206c-3cc1-4770-8126-0788c541f7a7 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:49.350245 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79206c-3cc1-4770-8126-0788c541f7a7 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:49.351879 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 78/157] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:49.362407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48dd22-db5a-4167-9eb3-169483651c26 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:49.362746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48dd22-db5a-4167-9eb3-169483651c26 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:49.362989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48dd22-db5a-4167-9eb3-169483651c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:49.394375 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-6c48dd22-db5a-4167-9eb3-169483651c26 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:49.395634 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-6c48dd22-db5a-4167-9eb3-169483651c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:49.416803 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da0a12-e455-4a0e-98d7-f3d28522f64d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:49.464382 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404ee16-bcc1-42fe-b859-fef4a8be33ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:49.464963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404ee16-bcc1-42fe-b859-fef4a8be33ae None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:49.465244 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404ee16-bcc1-42fe-b859-fef4a8be33ae None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:49.465521 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404ee16-bcc1-42fe-b859-fef4a8be33ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:49.466561 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404ee16-bcc1-42fe-b859-fef4a8be33ae None admin] RBAC: Adding query filter params (role.id=7b0becbc0d8a464b83a0b90da1e48a67, scope.project.id=d2bf11410fd84f91989477a0c73ba52d, user.id=ae590453bcf24b44a05cef758b0a5f0e) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:49.466911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404ee16-bcc1-42fe-b859-fef4a8be33ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:49.469031 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404ee16-bcc1-42fe-b859-fef4a8be33ae None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:49.477027 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 80/158] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:55:49 2022] GET /identity/v3/role_assignments?user.id=ae590453bcf24b44a05cef758b0a5f0e&scope.project.id=d2bf11410fd84f91989477a0c73ba52d&role.id=7b0becbc0d8a464b83a0b90da1e48a67 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:49.518588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 79/159] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:55:49.584335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404ee16-bcc1-42fe-b859-fef4a8be33ae None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:49.607743 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbeecc-fbbf-429e-8268-4189e60cb917 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:49.608370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbeecc-fbbf-429e-8268-4189e60cb917 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:49.608370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbeecc-fbbf-429e-8268-4189e60cb917 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:49.609817 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 80/160] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:55:49.615118 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d98dc-a3ae-4c67-9cbf-a3e5410c8b5a None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:49.615402 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d98dc-a3ae-4c67-9cbf-a3e5410c8b5a None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:49.615679 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d98dc-a3ae-4c67-9cbf-a3e5410c8b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:49.647253 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-e68d98dc-a3ae-4c67-9cbf-a3e5410c8b5a None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:49.648509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-e68d98dc-a3ae-4c67-9cbf-a3e5410c8b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:49.739088 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:49.746481 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:49.815615 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404ee16-bcc1-42fe-b859-fef4a8be33ae None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:49.821818 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 81/161] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:55:49.848016 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d98dc-a3ae-4c67-9cbf-a3e5410c8b5a None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:49.862863 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652854bf-119d-4e7e-9000-895a993d5dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:49.864013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652854bf-119d-4e7e-9000-895a993d5dc5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:49.864496 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652854bf-119d-4e7e-9000-895a993d5dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:49.864966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652854bf-119d-4e7e-9000-895a993d5dc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:49.888799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652854bf-119d-4e7e-9000-895a993d5dc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:49.906925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-652854bf-119d-4e7e-9000-895a993d5dc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:55:49.906925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:49.906925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:49.906925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:49.906925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:49.906925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:49.906925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:49.906925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:49.906925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:49.906925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:49.906925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:49.906925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:49.906925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:49.906925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:49.906925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:49.906925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:49.907870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:49.907870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:49.907870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:49.907870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:49.907870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:49.907870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:49.907870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:49.907870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:49.907870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:49.907870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:49.907870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:49.907870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:49.907870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:49.907870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:49.907870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:49.907870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:49.908688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:49.908688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:49.908688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:49.908688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:49.908688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:49.908688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:49.908688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:49.908688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:49.908688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:49.908688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:49.908688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:55:49.908688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:55:49.908688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 81/162] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:49.914520 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652854bf-119d-4e7e-9000-895a993d5dc5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:50.010584 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d98dc-a3ae-4c67-9cbf-a3e5410c8b5a None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:50.053956 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb93ad6-c303-463c-856c-ae7a3035fc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:50.055693 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb93ad6-c303-463c-856c-ae7a3035fc9e None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:50.056217 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb93ad6-c303-463c-856c-ae7a3035fc9e None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:50.056709 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb93ad6-c303-463c-856c-ae7a3035fc9e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:50.072214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb93ad6-c303-463c-856c-ae7a3035fc9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:50.082023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-0eb93ad6-c303-463c-856c-ae7a3035fc9e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:55:50.082023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:50.082023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:50.082023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:50.082023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:50.082023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:50.082023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:50.082023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:50.082023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:50.082023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:50.082023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:50.082023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:50.082023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:50.082023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:50.082023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:50.082023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:50.085754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:50.085754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:50.085754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:50.085754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:50.085754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:50.085754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:50.085754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:50.085754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:50.085754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:50.085754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:50.085754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:50.085754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:50.085754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:50.085754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:50.085754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:50.085754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:50.086569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:50.086569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:50.086569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:50.086569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:50.086569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:50.086569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:50.086569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:50.086569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:50.086569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:50.086569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:50.086569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:55:50.086569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:55:50.089260 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 82/163] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:55:50.095393 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb93ad6-c303-463c-856c-ae7a3035fc9e None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:50.136388 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:50.157551 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652854bf-119d-4e7e-9000-895a993d5dc5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:50.205634 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:50.231360 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50b96e-3e34-4f47-9c78-da4d4298eb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:50.232227 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50b96e-3e34-4f47-9c78-da4d4298eb2f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:50.232495 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50b96e-3e34-4f47-9c78-da4d4298eb2f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:50.232659 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50b96e-3e34-4f47-9c78-da4d4298eb2f None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:50.233511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50b96e-3e34-4f47-9c78-da4d4298eb2f None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:50.233850 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50b96e-3e34-4f47-9c78-da4d4298eb2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:50.235274 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50b96e-3e34-4f47-9c78-da4d4298eb2f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:50.236421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb93ad6-c303-463c-856c-ae7a3035fc9e None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:50.244882 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 82/164] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:55:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:50.246450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84eff51-cb5b-4d36-ae20-2b53751d92a5 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:50.246826 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84eff51-cb5b-4d36-ae20-2b53751d92a5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:50.247108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84eff51-cb5b-4d36-ae20-2b53751d92a5 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:50.249130 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 83/165] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:50.254507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7583a7a-266d-4329-b9ea-38b43b9e9171 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:50.254838 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7583a7a-266d-4329-b9ea-38b43b9e9171 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:50.255119 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7583a7a-266d-4329-b9ea-38b43b9e9171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:50.272655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-e7583a7a-266d-4329-b9ea-38b43b9e9171 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:50.273878 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e7583a7a-266d-4329-b9ea-38b43b9e9171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:50.282706 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8fab5-c000-4443-aec9-b1de76d35eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:50.283677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8fab5-c000-4443-aec9-b1de76d35eca None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:50.284158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8fab5-c000-4443-aec9-b1de76d35eca None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:50.285069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8fab5-c000-4443-aec9-b1de76d35eca None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:50.286975 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8fab5-c000-4443-aec9-b1de76d35eca None admin] RBAC: Adding query filter params (name=reader) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:50.287772 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8fab5-c000-4443-aec9-b1de76d35eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:50.289669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8fab5-c000-4443-aec9-b1de76d35eca None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:50.301913 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 83/166] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:55:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:50.303337 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8fab5-c000-4443-aec9-b1de76d35eca None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:50.359910 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 84/167] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:50.360938 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7583a7a-266d-4329-b9ea-38b43b9e9171 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:50.423514 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:50.432532 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8fab5-c000-4443-aec9-b1de76d35eca None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:50.471417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1bb18-bfc8-4c8c-9660-f7083e2c8182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:50.472315 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1bb18-bfc8-4c8c-9660-f7083e2c8182 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:50.472596 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1bb18-bfc8-4c8c-9660-f7083e2c8182 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:50.472876 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1bb18-bfc8-4c8c-9660-f7083e2c8182 None admin] PATH_INFO: `/v3/users/ae590453bcf24b44a05cef758b0a5f0e` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:50.474191 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1bb18-bfc8-4c8c-9660-f7083e2c8182 None admin] RBAC: Authorizing `identity:get_user(user_id=ae590453bcf24b44a05cef758b0a5f0e)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:50.475750 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1bb18-bfc8-4c8c-9660-f7083e2c8182 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:50.477678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 84/168] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:50 2022] GET /identity/v3/users/ae590453bcf24b44a05cef758b0a5f0e => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:50.478318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1bb18-bfc8-4c8c-9660-f7083e2c8182 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:50.561955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7583a7a-266d-4329-b9ea-38b43b9e9171 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:50.577333 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:50.633375 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b841c14-6991-4cbe-beb4-0679cd91a398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:50.634349 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b841c14-6991-4cbe-beb4-0679cd91a398 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:50.634606 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b841c14-6991-4cbe-beb4-0679cd91a398 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:50.634921 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b841c14-6991-4cbe-beb4-0679cd91a398 None admin] PATH_INFO: `/v3/users/5ec211c517a6449e85af812a120e92da` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:50.638273 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b841c14-6991-4cbe-beb4-0679cd91a398 None admin] RBAC: Authorizing `identity:get_user(user_id=5ec211c517a6449e85af812a120e92da)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:50.640030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b841c14-6991-4cbe-beb4-0679cd91a398 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:50.641863 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 85/169] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:50 2022] GET /identity/v3/users/5ec211c517a6449e85af812a120e92da => generated 289 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:50.642468 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b841c14-6991-4cbe-beb4-0679cd91a398 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:50.683645 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1bb18-bfc8-4c8c-9660-f7083e2c8182 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:50.751828 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56039b5c-872d-4a4b-8a58-cee148a76006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:50.752630 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56039b5c-872d-4a4b-8a58-cee148a76006 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:50.752913 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56039b5c-872d-4a4b-8a58-cee148a76006 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:50.753190 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56039b5c-872d-4a4b-8a58-cee148a76006 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:50.770497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56039b5c-872d-4a4b-8a58-cee148a76006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:50.778126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-56039b5c-872d-4a4b-8a58-cee148a76006 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:55:50.778126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:50.778126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:50.778126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:50.778126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:50.778126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:50.778126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:50.778126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:50.778126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:50.778126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:50.778126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:50.778126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:50.778126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:50.778126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:50.778126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:50.778126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:50.779714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:50.779714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:50.779714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:50.779714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:50.779714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:50.779714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:50.779714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:50.779714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:50.779714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:50.779714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:50.779714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:50.779714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:50.779714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:50.779714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:50.779714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:50.779714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:50.780467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:50.780467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:50.780467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:50.780467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:50.780467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:50.780467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:50.780467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:50.780467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:50.780467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:50.780467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:50.780467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:55:50.780467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:55:50.786876 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 85/170] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:55:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:50.789683 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56039b5c-872d-4a4b-8a58-cee148a76006 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:50.835472 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:50.841997 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b841c14-6991-4cbe-beb4-0679cd91a398 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:50.923835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56039b5c-872d-4a4b-8a58-cee148a76006 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:50.945740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecbaf4-873f-441e-9db1-d10536b1bb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:50.946844 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecbaf4-873f-441e-9db1-d10536b1bb82 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:50.947360 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecbaf4-873f-441e-9db1-d10536b1bb82 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:50.947828 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecbaf4-873f-441e-9db1-d10536b1bb82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:50.965447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2469791-d731-48ee-8bee-12f27fd1d8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:50.966353 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2469791-d731-48ee-8bee-12f27fd1d8bf None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:50.966657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2469791-d731-48ee-8bee-12f27fd1d8bf None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:50.967033 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2469791-d731-48ee-8bee-12f27fd1d8bf None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:50.968268 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2469791-d731-48ee-8bee-12f27fd1d8bf None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:50.969722 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2469791-d731-48ee-8bee-12f27fd1d8bf None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:50.971543 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 86/171] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:50 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:50.972326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2469791-d731-48ee-8bee-12f27fd1d8bf None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:51.071096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:51.075089 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:51.081198 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2469791-d731-48ee-8bee-12f27fd1d8bf None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:51.119523 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990a121-5450-428c-9373-067b29d95a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:51.120113 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990a121-5450-428c-9373-067b29d95a8e None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:51.120397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990a121-5450-428c-9373-067b29d95a8e None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:51.120670 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990a121-5450-428c-9373-067b29d95a8e None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:51.121418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990a121-5450-428c-9373-067b29d95a8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:51.121720 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990a121-5450-428c-9373-067b29d95a8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:51.123229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990a121-5450-428c-9373-067b29d95a8e None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:51.125500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecbaf4-873f-441e-9db1-d10536b1bb82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:51.127005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecbaf4-873f-441e-9db1-d10536b1bb82 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:51.132182 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 87/172] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:51.133232 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990a121-5450-428c-9373-067b29d95a8e None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:51.257738 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990a121-5450-428c-9373-067b29d95a8e None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:51.296799 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02605239-4969-42ca-a0ef-3f44e100e74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:51.297700 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02605239-4969-42ca-a0ef-3f44e100e74a None admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:51.297980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02605239-4969-42ca-a0ef-3f44e100e74a None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:51.298255 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02605239-4969-42ca-a0ef-3f44e100e74a None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d/users/5ec211c517a6449e85af812a120e92da/roles/e31991ec4dc346aca330fca5d28c258f` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:51.300911 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02605239-4969-42ca-a0ef-3f44e100e74a None admin] RBAC: Authorizing `identity:create_grant(project_id=d2bf11410fd84f91989477a0c73ba52d, user_id=5ec211c517a6449e85af812a120e92da, role_id=e31991ec4dc346aca330fca5d28c258f)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:51.302399 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02605239-4969-42ca-a0ef-3f44e100e74a None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:51.321493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 88/173] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Jul 11 11:55:51 2022] PUT /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d/users/5ec211c517a6449e85af812a120e92da/roles/e31991ec4dc346aca330fca5d28c258f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:55:51.322380 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02605239-4969-42ca-a0ef-3f44e100e74a None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:51.351489 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:51.363374 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 86/174] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:55:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:55:51.365457 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc6102-130c-488b-85db-6f1956865433 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:51.365858 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc6102-130c-488b-85db-6f1956865433 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:51.366238 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc6102-130c-488b-85db-6f1956865433 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:51.374893 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 87/175] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:51.374893 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc6102-130c-488b-85db-6f1956865433 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:51.531863 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:51.540467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02605239-4969-42ca-a0ef-3f44e100e74a None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:51.565115 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc6102-130c-488b-85db-6f1956865433 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:51.582296 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c9a2c-8c78-4649-8d52-0bd0b5e89a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:51.583401 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c9a2c-8c78-4649-8d52-0bd0b5e89a97 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:51.583751 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c9a2c-8c78-4649-8d52-0bd0b5e89a97 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:51.584101 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c9a2c-8c78-4649-8d52-0bd0b5e89a97 None admin] PATH_INFO: `/v3/users/df8711dbef0e4322ab4112544df903c1` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:51.585410 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c9a2c-8c78-4649-8d52-0bd0b5e89a97 None admin] RBAC: Authorizing `identity:get_user(user_id=df8711dbef0e4322ab4112544df903c1)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:51.587003 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c9a2c-8c78-4649-8d52-0bd0b5e89a97 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:51.589050 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 89/176] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:51 2022] GET /identity/v3/users/df8711dbef0e4322ab4112544df903c1 => generated 247 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:51.590316 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae9118-3eae-4ec1-af3a-9e976507d470 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:51.590724 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae9118-3eae-4ec1-af3a-9e976507d470 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:51.591149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae9118-3eae-4ec1-af3a-9e976507d470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:51.607478 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979e47-d2db-4c69-bed8-2d37a5ce2361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:51.608877 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979e47-d2db-4c69-bed8-2d37a5ce2361 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:51.609285 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-5dae9118-3eae-4ec1-af3a-9e976507d470 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:51.609510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979e47-d2db-4c69-bed8-2d37a5ce2361 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:51.609934 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979e47-d2db-4c69-bed8-2d37a5ce2361 None admin] PATH_INFO: `/v3/projects/ef565d7dde194ab5beaeb9815600c4a4` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:51.610791 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-5dae9118-3eae-4ec1-af3a-9e976507d470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:51.611606 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b979e47-d2db-4c69-bed8-2d37a5ce2361 None admin] RBAC: Authorizing `identity:get_project(project_id=ef565d7dde194ab5beaeb9815600c4a4)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:51.613423 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b979e47-d2db-4c69-bed8-2d37a5ce2361 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:51.615557 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 88/177] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:51 2022] GET /identity/v3/projects/ef565d7dde194ab5beaeb9815600c4a4 => generated 312 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:51.616544 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979e47-d2db-4c69-bed8-2d37a5ce2361 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:51.686833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 90/178] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:51.686833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae9118-3eae-4ec1-af3a-9e976507d470 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:51.700974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:51.756599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979e47-d2db-4c69-bed8-2d37a5ce2361 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:51.803091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df30cd9-b380-4511-9286-ddf6ea8b8190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:51.804170 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df30cd9-b380-4511-9286-ddf6ea8b8190 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:51.804646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df30cd9-b380-4511-9286-ddf6ea8b8190 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:51.805099 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df30cd9-b380-4511-9286-ddf6ea8b8190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:51.818420 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae9118-3eae-4ec1-af3a-9e976507d470 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:51.823353 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:51.862738 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24bb1e-0432-4b70-8d15-db0cab6afcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:51.863886 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24bb1e-0432-4b70-8d15-db0cab6afcf5 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:51.864267 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24bb1e-0432-4b70-8d15-db0cab6afcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:51.864634 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24bb1e-0432-4b70-8d15-db0cab6afcf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:51.865803 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24bb1e-0432-4b70-8d15-db0cab6afcf5 None admin] RBAC: Adding query filter params (role.id=a4345a1838084e3494c3e85dfb3225b4, scope.project.id=ef565d7dde194ab5beaeb9815600c4a4, user.id=ae590453bcf24b44a05cef758b0a5f0e) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:51.866188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24bb1e-0432-4b70-8d15-db0cab6afcf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:51.867918 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24bb1e-0432-4b70-8d15-db0cab6afcf5 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:51.875488 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 91/179] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:55:51 2022] GET /identity/v3/role_assignments?user.id=ae590453bcf24b44a05cef758b0a5f0e&scope.project.id=ef565d7dde194ab5beaeb9815600c4a4&role.id=a4345a1838084e3494c3e85dfb3225b4 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:51.879919 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23914fb6-0b1a-4d13-ba9f-d2fbfa3a7597 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:51.879919 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23914fb6-0b1a-4d13-ba9f-d2fbfa3a7597 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:51.879919 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23914fb6-0b1a-4d13-ba9f-d2fbfa3a7597 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:51.879919 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 92/180] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:51.879919 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23914fb6-0b1a-4d13-ba9f-d2fbfa3a7597 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:51.918865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df30cd9-b380-4511-9286-ddf6ea8b8190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:51.922388 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df30cd9-b380-4511-9286-ddf6ea8b8190 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:52.002244 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:52.034865 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23914fb6-0b1a-4d13-ba9f-d2fbfa3a7597 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:52.081784 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 89/181] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:55:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:55:52.081784 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f133f46-0546-4286-b6a1-7862b16f2e41 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:52.081784 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f133f46-0546-4286-b6a1-7862b16f2e41 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:52.081784 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f133f46-0546-4286-b6a1-7862b16f2e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:52.088485 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906aa9b9-f63d-4809-8b78-66a4d354cc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:52.089287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906aa9b9-f63d-4809-8b78-66a4d354cc1e None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:52.089620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906aa9b9-f63d-4809-8b78-66a4d354cc1e None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:52.089896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906aa9b9-f63d-4809-8b78-66a4d354cc1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:52.102436 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-6f133f46-0546-4286-b6a1-7862b16f2e41 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:52.103340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906aa9b9-f63d-4809-8b78-66a4d354cc1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:52.103691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6f133f46-0546-4286-b6a1-7862b16f2e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:52.112425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-906aa9b9-f63d-4809-8b78-66a4d354cc1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:55:52.112425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:52.112425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:52.112425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:52.112425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:52.112425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:52.112425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:52.112425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:52.112425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:52.112425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:52.112425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:52.112425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:52.112425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:52.112425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:52.112425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:52.112425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:52.113483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:52.113483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:52.113483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:52.113483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:52.113483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:52.113483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:52.113483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:52.113483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:52.113483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:52.113483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:52.113483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:52.113483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:52.113483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:52.113483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:52.113483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:52.113483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:52.114455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:52.114455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:52.114455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:52.114455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:52.114455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:52.114455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:52.114455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:52.114455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:52.114455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:52.114455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:52.114455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:55:52.114455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:55:52.117326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 93/182] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:55:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:52.119798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01efaff-0c1f-46aa-a8fc-24b3561390ac None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:52.119798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01efaff-0c1f-46aa-a8fc-24b3561390ac None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:52.119798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01efaff-0c1f-46aa-a8fc-24b3561390ac None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:52.121111 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 94/183] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:52.124183 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01efaff-0c1f-46aa-a8fc-24b3561390ac None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:52.158261 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:52.197809 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 90/184] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:52.203841 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f133f46-0546-4286-b6a1-7862b16f2e41 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:52.253868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01efaff-0c1f-46aa-a8fc-24b3561390ac None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:52.290413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdc02b-ec88-40a8-bb2f-c1bb7df28e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:52.291454 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdc02b-ec88-40a8-bb2f-c1bb7df28e0f None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:52.291937 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdc02b-ec88-40a8-bb2f-c1bb7df28e0f None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:52.292307 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdc02b-ec88-40a8-bb2f-c1bb7df28e0f None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:52.293630 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdc02b-ec88-40a8-bb2f-c1bb7df28e0f None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:52.295804 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdc02b-ec88-40a8-bb2f-c1bb7df28e0f None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:52.304151 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 95/185] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:52 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:52.304151 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172ae9c-1a39-4fa0-acc1-c6f8e44006a2 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:52.304151 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172ae9c-1a39-4fa0-acc1-c6f8e44006a2 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:52.304151 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172ae9c-1a39-4fa0-acc1-c6f8e44006a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:52.308546 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:52.321785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-3172ae9c-1a39-4fa0-acc1-c6f8e44006a2 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:52.323042 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-3172ae9c-1a39-4fa0-acc1-c6f8e44006a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:52.328587 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f133f46-0546-4286-b6a1-7862b16f2e41 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:52.371569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41087964-77a2-4b46-ab9a-2bb3a0405088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:52.372800 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41087964-77a2-4b46-ab9a-2bb3a0405088 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:52.373058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41087964-77a2-4b46-ab9a-2bb3a0405088 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:52.373329 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41087964-77a2-4b46-ab9a-2bb3a0405088 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:52.374062 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41087964-77a2-4b46-ab9a-2bb3a0405088 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:52.374366 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41087964-77a2-4b46-ab9a-2bb3a0405088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:52.375797 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41087964-77a2-4b46-ab9a-2bb3a0405088 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:52.384472 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 91/186] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:52.387732 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41087964-77a2-4b46-ab9a-2bb3a0405088 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:52.396415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 96/187] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:52.397545 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172ae9c-1a39-4fa0-acc1-c6f8e44006a2 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:52.442638 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:52.504163 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41087964-77a2-4b46-ab9a-2bb3a0405088 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:52.518309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172ae9c-1a39-4fa0-acc1-c6f8e44006a2 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:52.539049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f175b-fa2f-4d4f-83cf-30eddfa985df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:52.539856 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f175b-fa2f-4d4f-83cf-30eddfa985df None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:52.540140 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f175b-fa2f-4d4f-83cf-30eddfa985df None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:52.540417 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f175b-fa2f-4d4f-83cf-30eddfa985df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:52.552060 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f175b-fa2f-4d4f-83cf-30eddfa985df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:52.557814 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93fdb2-98ee-44c6-8a61-d8ed93187cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:52.558693 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93fdb2-98ee-44c6-8a61-d8ed93187cb7 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:52.559200 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93fdb2-98ee-44c6-8a61-d8ed93187cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:52.559689 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93fdb2-98ee-44c6-8a61-d8ed93187cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:52.560667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-fa8f175b-fa2f-4d4f-83cf-30eddfa985df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:55:52.560667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:52.560667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:52.560667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:52.560667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:52.560667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:52.560667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:52.560667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:52.560667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:52.560667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:52.560667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:52.560667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:52.560667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:52.560667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:52.560667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:52.560667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:52.561500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:52.561500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:52.561500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:52.561500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:52.561500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:52.561500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:52.561500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:52.561500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:52.561500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:52.561500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:52.561500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:52.561500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:52.561500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:52.561500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:52.561500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:52.561500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:52.563217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:52.563217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:52.563217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:52.563217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:52.563217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:52.563217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:52.563217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:52.563217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:52.563217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:52.563217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:52.563217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:55:52.563217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:55:52.563217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 92/188] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:55:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:52.563217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f175b-fa2f-4d4f-83cf-30eddfa985df None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:52.566652 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93fdb2-98ee-44c6-8a61-d8ed93187cb7 None admin] RBAC: Adding query filter params (role.id=11fc9dc7c3664b2b8af8eee2462707b8, scope.project.id=d2bf11410fd84f91989477a0c73ba52d, user.id=df8711dbef0e4322ab4112544df903c1) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:52.566978 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93fdb2-98ee-44c6-8a61-d8ed93187cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:52.568437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93fdb2-98ee-44c6-8a61-d8ed93187cb7 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:52.570666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:52.576625 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 97/189] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:55:52 2022] GET /identity/v3/role_assignments?user.id=df8711dbef0e4322ab4112544df903c1&scope.project.id=d2bf11410fd84f91989477a0c73ba52d&role.id=11fc9dc7c3664b2b8af8eee2462707b8 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:52.584084 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93fdb2-98ee-44c6-8a61-d8ed93187cb7 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:52.697193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:52.704000 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f175b-fa2f-4d4f-83cf-30eddfa985df None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:52.732855 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93fdb2-98ee-44c6-8a61-d8ed93187cb7 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:52.748302 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc93a32-51d3-4d12-a235-7cf2d6c1377f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:52.749385 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc93a32-51d3-4d12-a235-7cf2d6c1377f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:52.749684 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc93a32-51d3-4d12-a235-7cf2d6c1377f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:52.750047 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc93a32-51d3-4d12-a235-7cf2d6c1377f None admin] PATH_INFO: `/v3/users/4ab8b62c8a994dd1aa089fd0d50368ce` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:52.772828 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc93a32-51d3-4d12-a235-7cf2d6c1377f None admin] RBAC: Authorizing `identity:get_user(user_id=4ab8b62c8a994dd1aa089fd0d50368ce)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:52.774574 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc93a32-51d3-4d12-a235-7cf2d6c1377f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:52.776344 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 93/190] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:52 2022] GET /identity/v3/users/4ab8b62c8a994dd1aa089fd0d50368ce => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:52.777224 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc93a32-51d3-4d12-a235-7cf2d6c1377f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:52.781753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187032e6-9cb6-4ce7-aeaa-19850750dea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:52.782947 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187032e6-9cb6-4ce7-aeaa-19850750dea9 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:52.783227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187032e6-9cb6-4ce7-aeaa-19850750dea9 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:52.783497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187032e6-9cb6-4ce7-aeaa-19850750dea9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:52.785712 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187032e6-9cb6-4ce7-aeaa-19850750dea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:52.786403 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187032e6-9cb6-4ce7-aeaa-19850750dea9 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:52.792232 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 98/191] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:55:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:52.793095 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187032e6-9cb6-4ce7-aeaa-19850750dea9 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:52.880871 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:52.902668 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc93a32-51d3-4d12-a235-7cf2d6c1377f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:52.917730 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187032e6-9cb6-4ce7-aeaa-19850750dea9 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:52.941021 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24a2ea-1b7c-4f88-afe4-42c6e0b9633c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:52.941789 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24a2ea-1b7c-4f88-afe4-42c6e0b9633c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:52.942126 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24a2ea-1b7c-4f88-afe4-42c6e0b9633c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:52.942407 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24a2ea-1b7c-4f88-afe4-42c6e0b9633c None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:52.943179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24a2ea-1b7c-4f88-afe4-42c6e0b9633c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:52.943484 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24a2ea-1b7c-4f88-afe4-42c6e0b9633c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:52.945083 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24a2ea-1b7c-4f88-afe4-42c6e0b9633c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:52.952259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62fc24-6c5a-4497-8834-4dba2c48848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:52.952908 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62fc24-6c5a-4497-8834-4dba2c48848b None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:52.953346 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 94/192] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:55:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:52.953449 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62fc24-6c5a-4497-8834-4dba2c48848b None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:52.953595 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62fc24-6c5a-4497-8834-4dba2c48848b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:52.955623 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24a2ea-1b7c-4f88-afe4-42c6e0b9633c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:52.977410 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:53.030701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62fc24-6c5a-4497-8834-4dba2c48848b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:53.032149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62fc24-6c5a-4497-8834-4dba2c48848b None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:53.063447 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24a2ea-1b7c-4f88-afe4-42c6e0b9633c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:53.097642 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b0f81-f805-463e-b60c-54c0b6718d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:53.098299 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b0f81-f805-463e-b60c-54c0b6718d5a None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:53.098580 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b0f81-f805-463e-b60c-54c0b6718d5a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:53.098882 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b0f81-f805-463e-b60c-54c0b6718d5a None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:53.099584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b0f81-f805-463e-b60c-54c0b6718d5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:53.101028 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b0f81-f805-463e-b60c-54c0b6718d5a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:53.103414 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:53.122684 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 95/193] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Jul 11 11:55:52 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:55:53.122684 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b0f81-f805-463e-b60c-54c0b6718d5a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:53.159831 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 99/194] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:55:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:55:53.165984 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62fc24-6c5a-4497-8834-4dba2c48848b None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:53.248093 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:53.280212 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b0f81-f805-463e-b60c-54c0b6718d5a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:53.318050 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62fc24-6c5a-4497-8834-4dba2c48848b None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:53.320291 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00050582-f423-4f2e-8e95-69a5c194e302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:53.321406 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00050582-f423-4f2e-8e95-69a5c194e302 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:53.321888 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00050582-f423-4f2e-8e95-69a5c194e302 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:53.322356 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00050582-f423-4f2e-8e95-69a5c194e302 None admin] PATH_INFO: `/v3/users/4ab8b62c8a994dd1aa089fd0d50368ce` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:53.323938 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00050582-f423-4f2e-8e95-69a5c194e302 None admin] RBAC: Authorizing `identity:get_user(user_id=4ab8b62c8a994dd1aa089fd0d50368ce)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:53.326985 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00050582-f423-4f2e-8e95-69a5c194e302 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:53.328919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 96/195] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:53 2022] GET /identity/v3/users/4ab8b62c8a994dd1aa089fd0d50368ce => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:53.334600 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00050582-f423-4f2e-8e95-69a5c194e302 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:53.368839 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb27fa-9e4d-4d75-810e-027f4d8aed9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:53.368839 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb27fa-9e4d-4d75-810e-027f4d8aed9a None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:53.368839 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb27fa-9e4d-4d75-810e-027f4d8aed9a None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:53.368839 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb27fa-9e4d-4d75-810e-027f4d8aed9a None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:53.369383 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb27fa-9e4d-4d75-810e-027f4d8aed9a None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:53.369992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb27fa-9e4d-4d75-810e-027f4d8aed9a None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:53.371934 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 100/196] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:53 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:53.379507 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb27fa-9e4d-4d75-810e-027f4d8aed9a None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:53.430391 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:53.473129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00050582-f423-4f2e-8e95-69a5c194e302 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:53.521459 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5360dbb-9636-41c4-a184-eb139b22326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:53.522985 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5360dbb-9636-41c4-a184-eb139b22326b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:53.523452 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5360dbb-9636-41c4-a184-eb139b22326b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:53.523895 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5360dbb-9636-41c4-a184-eb139b22326b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:53.525394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb27fa-9e4d-4d75-810e-027f4d8aed9a None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:53.543680 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:53.576172 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910154a2-3b63-43a3-9ce0-d0a28ba124ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:53.576809 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910154a2-3b63-43a3-9ce0-d0a28ba124ed None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:53.577094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910154a2-3b63-43a3-9ce0-d0a28ba124ed None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:53.577362 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910154a2-3b63-43a3-9ce0-d0a28ba124ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:53.578193 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910154a2-3b63-43a3-9ce0-d0a28ba124ed None admin] RBAC: Adding query filter params (role.id=11fc9dc7c3664b2b8af8eee2462707b8, scope.project.id=048e800f61d84e729c209484f6bd0635, user.id=4ab8b62c8a994dd1aa089fd0d50368ce) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:53.578498 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910154a2-3b63-43a3-9ce0-d0a28ba124ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:53.581031 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910154a2-3b63-43a3-9ce0-d0a28ba124ed None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:53.587856 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 101/197] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:55:53 2022] GET /identity/v3/role_assignments?user.id=4ab8b62c8a994dd1aa089fd0d50368ce&scope.project.id=048e800f61d84e729c209484f6bd0635&role.id=11fc9dc7c3664b2b8af8eee2462707b8 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:53.627201 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5360dbb-9636-41c4-a184-eb139b22326b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:53.628779 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5360dbb-9636-41c4-a184-eb139b22326b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:53.753854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 97/198] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:55:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 11:55:53.759671 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910154a2-3b63-43a3-9ce0-d0a28ba124ed None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:53.831519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad62137-91b9-4563-ba17-45a2cfc3faf2 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:53.831810 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad62137-91b9-4563-ba17-45a2cfc3faf2 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:53.831997 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad62137-91b9-4563-ba17-45a2cfc3faf2 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:53.837036 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 98/199] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:53.838926 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaa352-6d14-4fa7-8ea5-9476d5e08464 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:53.839418 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaa352-6d14-4fa7-8ea5-9476d5e08464 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:53.839905 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaa352-6d14-4fa7-8ea5-9476d5e08464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:53.859337 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b9eaa352-6d14-4fa7-8ea5-9476d5e08464 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:53.861026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b9eaa352-6d14-4fa7-8ea5-9476d5e08464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:53.901010 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:53.929496 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:53.937732 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910154a2-3b63-43a3-9ce0-d0a28ba124ed None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:53.939878 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 99/200] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:55:53.977548 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a35e6b-165f-4c98-b1a5-7049933314bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:53.979157 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a35e6b-165f-4c98-b1a5-7049933314bb None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:53.979653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a35e6b-165f-4c98-b1a5-7049933314bb None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:53.980118 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a35e6b-165f-4c98-b1a5-7049933314bb None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:53.981594 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a35e6b-165f-4c98-b1a5-7049933314bb None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:53.983348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a35e6b-165f-4c98-b1a5-7049933314bb None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:53.991734 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eaa352-6d14-4fa7-8ea5-9476d5e08464 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:54.003002 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 102/201] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:53 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:54.008752 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a35e6b-165f-4c98-b1a5-7049933314bb None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:54.112670 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eaa352-6d14-4fa7-8ea5-9476d5e08464 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:54.153170 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac4c2a-0674-4f53-8bdb-37096519ba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:54.156234 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac4c2a-0674-4f53-8bdb-37096519ba29 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:54.156234 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac4c2a-0674-4f53-8bdb-37096519ba29 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:54.156234 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac4c2a-0674-4f53-8bdb-37096519ba29 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:54.167618 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac4c2a-0674-4f53-8bdb-37096519ba29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:54.177180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-81ac4c2a-0674-4f53-8bdb-37096519ba29 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:55:54.177180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:54.177180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:54.177180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:54.177180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:54.177180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:54.177180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:54.177180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:54.177180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:54.177180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:54.177180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:54.177180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:54.177180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:54.177180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:54.177180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:54.177180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:54.178106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:54.178106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:54.178106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:54.178106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:54.178106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:54.178106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:54.178106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:54.178106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:54.178106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:54.178106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:54.178106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:54.178106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:54.178106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:54.178106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:54.178106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:54.178106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:54.179003 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:54.179003 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:54.179003 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:54.179003 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:54.179003 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:54.179003 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:54.179003 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:54.179003 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:54.179003 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:54.179003 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:54.179003 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:55:54.179003 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:55:54.179003 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 100/202] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:54.185092 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac4c2a-0674-4f53-8bdb-37096519ba29 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:54.217285 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a35e6b-165f-4c98-b1a5-7049933314bb None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:54.219088 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:54.316120 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac4c2a-0674-4f53-8bdb-37096519ba29 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:54.329789 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac19b75-3225-4780-b9ca-ca3bcb8c158d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:54.330450 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac19b75-3225-4780-b9ca-ca3bcb8c158d None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:54.330743 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac19b75-3225-4780-b9ca-ca3bcb8c158d None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:54.331088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac19b75-3225-4780-b9ca-ca3bcb8c158d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:54.331930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac19b75-3225-4780-b9ca-ca3bcb8c158d None admin] RBAC: Adding query filter params (role.id=7b0becbc0d8a464b83a0b90da1e48a67, scope.project.id=048e800f61d84e729c209484f6bd0635, user.id=4ab8b62c8a994dd1aa089fd0d50368ce) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:54.332233 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac19b75-3225-4780-b9ca-ca3bcb8c158d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:54.333679 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac19b75-3225-4780-b9ca-ca3bcb8c158d None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:54.349083 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 103/203] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:55:54 2022] GET /identity/v3/role_assignments?user.id=4ab8b62c8a994dd1aa089fd0d50368ce&scope.project.id=048e800f61d84e729c209484f6bd0635&role.id=7b0becbc0d8a464b83a0b90da1e48a67 => generated 259 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:54.376761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8bd32-05ca-46a2-bc3e-e8d4079d999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:54.377460 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8bd32-05ca-46a2-bc3e-e8d4079d999b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:54.377747 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8bd32-05ca-46a2-bc3e-e8d4079d999b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:54.378025 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8bd32-05ca-46a2-bc3e-e8d4079d999b None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:54.378837 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8bd32-05ca-46a2-bc3e-e8d4079d999b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:54.379229 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8bd32-05ca-46a2-bc3e-e8d4079d999b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:54.380705 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8bd32-05ca-46a2-bc3e-e8d4079d999b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:54.399359 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 101/204] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:55:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:54.407914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac19b75-3225-4780-b9ca-ca3bcb8c158d None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:54.511112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:54.603701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac19b75-3225-4780-b9ca-ca3bcb8c158d None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:54.640043 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179f361-86c0-4261-8088-7df07219cd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:54.641576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179f361-86c0-4261-8088-7df07219cd44 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:54.641919 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179f361-86c0-4261-8088-7df07219cd44 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:54.642197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179f361-86c0-4261-8088-7df07219cd44 None admin] PATH_INFO: `/v3/users/5ec211c517a6449e85af812a120e92da` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:54.645597 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179f361-86c0-4261-8088-7df07219cd44 None admin] RBAC: Authorizing `identity:get_user(user_id=5ec211c517a6449e85af812a120e92da)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:54.647146 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179f361-86c0-4261-8088-7df07219cd44 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:54.650767 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 104/205] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:54 2022] GET /identity/v3/users/5ec211c517a6449e85af812a120e92da => generated 289 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:54.657527 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8bd32-05ca-46a2-bc3e-e8d4079d999b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:54.878585 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:54.907358 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8bd32-05ca-46a2-bc3e-e8d4079d999b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:54.997034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05201cd0-2b94-445f-829a-9a5869bc3d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:54.997694 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05201cd0-2b94-445f-829a-9a5869bc3d04 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:54.997976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05201cd0-2b94-445f-829a-9a5869bc3d04 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:54.998247 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05201cd0-2b94-445f-829a-9a5869bc3d04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:55.207603 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05201cd0-2b94-445f-829a-9a5869bc3d04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:55.209100 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05201cd0-2b94-445f-829a-9a5869bc3d04 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:55.396254 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:55.409623 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 102/206] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:55:55.414829 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179f361-86c0-4261-8088-7df07219cd44 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:55.561132 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:55.570526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179f361-86c0-4261-8088-7df07219cd44 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:55.625694 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546ddc0-304b-44c6-a14a-181976c2df88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:55.626569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546ddc0-304b-44c6-a14a-181976c2df88 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:55.626873 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546ddc0-304b-44c6-a14a-181976c2df88 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:55.627144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546ddc0-304b-44c6-a14a-181976c2df88 None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:55.628348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546ddc0-304b-44c6-a14a-181976c2df88 None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:55.629807 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546ddc0-304b-44c6-a14a-181976c2df88 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:55.631533 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 105/207] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:55 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:55.640330 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05201cd0-2b94-445f-829a-9a5869bc3d04 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:55.779761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05201cd0-2b94-445f-829a-9a5869bc3d04 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:55.825977 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b30152-7388-4bfb-852d-1891978f4fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:55.826564 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b30152-7388-4bfb-852d-1891978f4fea None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:55.826918 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b30152-7388-4bfb-852d-1891978f4fea None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:55.827288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b30152-7388-4bfb-852d-1891978f4fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:55.828191 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b30152-7388-4bfb-852d-1891978f4fea None admin] RBAC: Adding query filter params (role.id=e31991ec4dc346aca330fca5d28c258f, scope.project.id=d2bf11410fd84f91989477a0c73ba52d, user.id=5ec211c517a6449e85af812a120e92da) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:55.828502 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b30152-7388-4bfb-852d-1891978f4fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:55.829972 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b30152-7388-4bfb-852d-1891978f4fea None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:55.842862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 103/208] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:55:55 2022] GET /identity/v3/role_assignments?user.id=5ec211c517a6449e85af812a120e92da&scope.project.id=d2bf11410fd84f91989477a0c73ba52d&role.id=e31991ec4dc346aca330fca5d28c258f => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:56.272527 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fe51d-1ae7-489c-8664-9b0c7aa5eae8 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:56.272809 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fe51d-1ae7-489c-8664-9b0c7aa5eae8 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:56.273246 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fe51d-1ae7-489c-8664-9b0c7aa5eae8 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:56.275132 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 106/209] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:56.281137 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205c81c-6660-4880-853e-742d9f8a44b6 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:56.281440 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205c81c-6660-4880-853e-742d9f8a44b6 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:56.281718 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205c81c-6660-4880-853e-742d9f8a44b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:56.299369 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-2205c81c-6660-4880-853e-742d9f8a44b6 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:56.300879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2205c81c-6660-4880-853e-742d9f8a44b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:56.361701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95184269-d38b-4d11-9881-a99f19829007 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:56.362308 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95184269-d38b-4d11-9881-a99f19829007 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:56.362767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:56.363429 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95184269-d38b-4d11-9881-a99f19829007 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:56.366425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 107/210] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:56.376185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02874cb1-2af4-4850-ac45-b94d363827e9 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:56.376472 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02874cb1-2af4-4850-ac45-b94d363827e9 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:56.376749 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02874cb1-2af4-4850-ac45-b94d363827e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:56.388760 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 104/211] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:56.397543 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b7647-fb6a-481d-88f3-135af734869d None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:56.398007 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b7647-fb6a-481d-88f3-135af734869d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:56.398421 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b7647-fb6a-481d-88f3-135af734869d None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:56.400167 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 105/212] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:55:56.403475 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-02874cb1-2af4-4850-ac45-b94d363827e9 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:56.404776 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-02874cb1-2af4-4850-ac45-b94d363827e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:56.405537 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8424f-4216-464e-b7ff-4637a0cbf057 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:56.405821 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8424f-4216-464e-b7ff-4637a0cbf057 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:56.406095 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8424f-4216-464e-b7ff-4637a0cbf057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:56.433466 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-a9a8424f-4216-464e-b7ff-4637a0cbf057 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:56.433466 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a9a8424f-4216-464e-b7ff-4637a0cbf057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:56.489346 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 108/213] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:56.491041 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02874cb1-2af4-4850-ac45-b94d363827e9 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:56.514608 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 106/214] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:55:56.515858 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8424f-4216-464e-b7ff-4637a0cbf057 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:56.600973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:56.608413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02874cb1-2af4-4850-ac45-b94d363827e9 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:56.622803 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8424f-4216-464e-b7ff-4637a0cbf057 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:56.640984 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:56.647803 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be8f89-c334-42bc-8726-46271e8ab053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:56.648892 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be8f89-c334-42bc-8726-46271e8ab053 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:56.649365 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be8f89-c334-42bc-8726-46271e8ab053 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:56.649652 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be8f89-c334-42bc-8726-46271e8ab053 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:56.650859 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be8f89-c334-42bc-8726-46271e8ab053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:56.652319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be8f89-c334-42bc-8726-46271e8ab053 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:56.654644 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 109/215] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:55:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:56.655442 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be8f89-c334-42bc-8726-46271e8ab053 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:56.665187 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9268b-5612-49d0-9978-28e673fc6f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:56.666279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9268b-5612-49d0-9978-28e673fc6f6f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:56.666702 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9268b-5612-49d0-9978-28e673fc6f6f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:56.667163 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9268b-5612-49d0-9978-28e673fc6f6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:56.679153 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9268b-5612-49d0-9978-28e673fc6f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:56.688006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-46d9268b-5612-49d0-9978-28e673fc6f6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:55:56.688006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:56.688006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:56.688006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:56.688006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:56.688006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:56.688006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:56.688006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:56.688006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:56.688006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:56.688006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:56.688006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:56.688006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:56.688006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:56.688006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:56.688006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:56.689016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:56.689016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:56.689016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:56.689016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:56.689016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:56.689016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:56.689016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:56.689016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:56.689016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:56.689016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:56.689016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:56.689016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:56.689016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:56.689016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:56.689016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:56.689016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:56.689976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:56.689976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:56.689976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:56.689976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:56.689976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:56.689976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:56.689976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:56.689976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:56.689976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:56.689976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:56.689976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:55:56.689976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:55:56.691986 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 107/216] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:55:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:56.692901 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9268b-5612-49d0-9978-28e673fc6f6f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:56.759249 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be8f89-c334-42bc-8726-46271e8ab053 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:56.797315 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa042c7-de85-4b17-ae87-f9275bbeae55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:56.798234 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa042c7-de85-4b17-ae87-f9275bbeae55 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:56.798521 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa042c7-de85-4b17-ae87-f9275bbeae55 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:56.799069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa042c7-de85-4b17-ae87-f9275bbeae55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:56.804402 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9268b-5612-49d0-9978-28e673fc6f6f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:56.811130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa042c7-de85-4b17-ae87-f9275bbeae55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:56.819465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-caa042c7-de85-4b17-ae87-f9275bbeae55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:55:56.819465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:56.819465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:56.819465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:56.819465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:56.819465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:56.819465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:56.819465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:56.819465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:56.819465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:56.819465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:56.819465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:56.819465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:56.819465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:56.819465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:56.819465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:56.820413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:56.820413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:56.820413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:56.820413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:56.820413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:56.820413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:56.820413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:56.820413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:56.820413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:56.820413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:56.820413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:56.820413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:56.820413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:56.820413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:56.820413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:56.820413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:56.821206 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:56.821206 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:56.821206 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:56.821206 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:56.821206 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:56.821206 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:56.821206 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:56.821206 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:56.821206 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:56.821206 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:56.821206 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:55:56.821206 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:55:56.821206 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 110/217] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:56.821859 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa042c7-de85-4b17-ae87-f9275bbeae55 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:56.845258 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531b871-bb18-4a74-94f5-b2b17be88f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:56.845926 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531b871-bb18-4a74-94f5-b2b17be88f8d None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:56.846206 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531b871-bb18-4a74-94f5-b2b17be88f8d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:56.846485 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531b871-bb18-4a74-94f5-b2b17be88f8d None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:56.847220 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531b871-bb18-4a74-94f5-b2b17be88f8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:56.848700 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531b871-bb18-4a74-94f5-b2b17be88f8d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:56.850264 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:56.869644 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 108/218] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Jul 11 11:55:56 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:55:56.879874 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531b871-bb18-4a74-94f5-b2b17be88f8d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:56.933609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:56.954626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa042c7-de85-4b17-ae87-f9275bbeae55 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:56.997717 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731035c5-06cd-4ff4-a6f0-860af8ba7159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:56.999059 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731035c5-06cd-4ff4-a6f0-860af8ba7159 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:56.999681 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731035c5-06cd-4ff4-a6f0-860af8ba7159 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:57.000196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731035c5-06cd-4ff4-a6f0-860af8ba7159 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:57.001165 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731035c5-06cd-4ff4-a6f0-860af8ba7159 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:57.001872 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731035c5-06cd-4ff4-a6f0-860af8ba7159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:57.003931 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731035c5-06cd-4ff4-a6f0-860af8ba7159 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:57.015324 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 111/219] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:55:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:57.026748 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731035c5-06cd-4ff4-a6f0-860af8ba7159 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:57.037063 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531b871-bb18-4a74-94f5-b2b17be88f8d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:57.082151 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf09fd-8ec0-4eec-aa4c-b48360e2ad21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:57.082887 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf09fd-8ec0-4eec-aa4c-b48360e2ad21 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:57.083168 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf09fd-8ec0-4eec-aa4c-b48360e2ad21 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:57.083478 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf09fd-8ec0-4eec-aa4c-b48360e2ad21 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:57.084257 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf09fd-8ec0-4eec-aa4c-b48360e2ad21 None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:57.084565 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf09fd-8ec0-4eec-aa4c-b48360e2ad21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:57.085966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf09fd-8ec0-4eec-aa4c-b48360e2ad21 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:57.096883 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 109/220] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:55:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:57.102255 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf09fd-8ec0-4eec-aa4c-b48360e2ad21 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:57.137255 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:57.156161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731035c5-06cd-4ff4-a6f0-860af8ba7159 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:57.203722 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32078516-f13e-4405-9153-8f196f496440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:57.204609 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32078516-f13e-4405-9153-8f196f496440 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:57.204973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32078516-f13e-4405-9153-8f196f496440 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:57.205704 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32078516-f13e-4405-9153-8f196f496440 None admin] PATH_INFO: `/v3/users/4ab8b62c8a994dd1aa089fd0d50368ce` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:57.207260 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32078516-f13e-4405-9153-8f196f496440 None admin] RBAC: Authorizing `identity:get_user(user_id=4ab8b62c8a994dd1aa089fd0d50368ce)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:57.208876 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32078516-f13e-4405-9153-8f196f496440 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:57.211671 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 112/221] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:57 2022] GET /identity/v3/users/4ab8b62c8a994dd1aa089fd0d50368ce => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:57.219427 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32078516-f13e-4405-9153-8f196f496440 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:57.243594 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:57.252063 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf09fd-8ec0-4eec-aa4c-b48360e2ad21 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:57.296365 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9b2e0-b0fd-4960-89b6-7e0c45cc5444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:57.297845 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9b2e0-b0fd-4960-89b6-7e0c45cc5444 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:57.298474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9b2e0-b0fd-4960-89b6-7e0c45cc5444 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:57.299307 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9b2e0-b0fd-4960-89b6-7e0c45cc5444 None admin] PATH_INFO: `/v3/users/3856f2405b0841298f960d48de3bf187` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:57.318778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9b2e0-b0fd-4960-89b6-7e0c45cc5444 None admin] RBAC: Authorizing `identity:get_user(user_id=3856f2405b0841298f960d48de3bf187)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:57.320272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9b2e0-b0fd-4960-89b6-7e0c45cc5444 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:57.322017 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 110/222] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:57 2022] GET /identity/v3/users/3856f2405b0841298f960d48de3bf187 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:57.328370 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9b2e0-b0fd-4960-89b6-7e0c45cc5444 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:57.360319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32078516-f13e-4405-9153-8f196f496440 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:57.406391 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a69d3e-1a95-42d0-a8d5-75fcb732c21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:57.407786 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a69d3e-1a95-42d0-a8d5-75fcb732c21c None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:57.408454 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a69d3e-1a95-42d0-a8d5-75fcb732c21c None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:57.409308 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a69d3e-1a95-42d0-a8d5-75fcb732c21c None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:57.410977 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a69d3e-1a95-42d0-a8d5-75fcb732c21c None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:57.413506 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a69d3e-1a95-42d0-a8d5-75fcb732c21c None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:57.416665 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 113/223] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:57 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:57.418081 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b4313-75d5-4ec4-8678-e0f99d385586 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:57.418864 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b4313-75d5-4ec4-8678-e0f99d385586 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:57.419332 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b4313-75d5-4ec4-8678-e0f99d385586 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:57.421740 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 114/224] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:57.422594 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b4313-75d5-4ec4-8678-e0f99d385586 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:57.453578 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:57.469825 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9b2e0-b0fd-4960-89b6-7e0c45cc5444 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:57.509508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8718f-e843-4eab-a639-e8d00f2c6a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:57.510161 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8718f-e843-4eab-a639-e8d00f2c6a77 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:57.510450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8718f-e843-4eab-a639-e8d00f2c6a77 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:57.510735 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8718f-e843-4eab-a639-e8d00f2c6a77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:57.537478 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:57.551545 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b4313-75d5-4ec4-8678-e0f99d385586 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:57.584709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8718f-e843-4eab-a639-e8d00f2c6a77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:57.586200 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8718f-e843-4eab-a639-e8d00f2c6a77 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:57.589725 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115d17c-3c18-4bc8-a75b-7739a5b50d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:57.591541 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115d17c-3c18-4bc8-a75b-7739a5b50d70 None admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:57.592041 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115d17c-3c18-4bc8-a75b-7739a5b50d70 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:57.592605 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115d17c-3c18-4bc8-a75b-7739a5b50d70 None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635/users/4ab8b62c8a994dd1aa089fd0d50368ce/roles/11fc9dc7c3664b2b8af8eee2462707b8` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:57.595512 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115d17c-3c18-4bc8-a75b-7739a5b50d70 None admin] RBAC: Authorizing `identity:create_grant(project_id=048e800f61d84e729c209484f6bd0635, user_id=4ab8b62c8a994dd1aa089fd0d50368ce, role_id=11fc9dc7c3664b2b8af8eee2462707b8)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:57.598378 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115d17c-3c18-4bc8-a75b-7739a5b50d70 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:57.614783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 115/225] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Jul 11 11:55:57 2022] PUT /identity/v3/projects/048e800f61d84e729c209484f6bd0635/users/4ab8b62c8a994dd1aa089fd0d50368ce/roles/11fc9dc7c3664b2b8af8eee2462707b8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:55:57.616745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919cf6a-cb28-462d-a988-f909b1812429 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:57.617144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919cf6a-cb28-462d-a988-f909b1812429 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:57.617555 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919cf6a-cb28-462d-a988-f909b1812429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:57.638228 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-f919cf6a-cb28-462d-a988-f909b1812429 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:57.639798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-f919cf6a-cb28-462d-a988-f909b1812429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:57.702324 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 111/226] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:55:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 11:55:57.708489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8718f-e843-4eab-a639-e8d00f2c6a77 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:57.760359 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 116/227] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:57.795083 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:57.799990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919cf6a-cb28-462d-a988-f909b1812429 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:57.817671 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:57.866854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8718f-e843-4eab-a639-e8d00f2c6a77 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:57.911806 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d4091-b89d-4fd4-b9ae-63af0a341b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:57.913143 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d4091-b89d-4fd4-b9ae-63af0a341b56 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:57.913703 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d4091-b89d-4fd4-b9ae-63af0a341b56 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:57.913994 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d4091-b89d-4fd4-b9ae-63af0a341b56 None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:57.915395 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d4091-b89d-4fd4-b9ae-63af0a341b56 None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:57.917243 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d4091-b89d-4fd4-b9ae-63af0a341b56 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:57.920271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 112/228] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:57 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:57.927241 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d4091-b89d-4fd4-b9ae-63af0a341b56 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:57.936543 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919cf6a-cb28-462d-a988-f909b1812429 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:57.992843 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645b9b9-8caa-427d-b83f-fba876aee4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:57.993663 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645b9b9-8caa-427d-b83f-fba876aee4d4 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:57.993952 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645b9b9-8caa-427d-b83f-fba876aee4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:57.994227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645b9b9-8caa-427d-b83f-fba876aee4d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:58.017030 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645b9b9-8caa-427d-b83f-fba876aee4d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:55:58.033603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-e645b9b9-8caa-427d-b83f-fba876aee4d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:55:58.033603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:55:58.033603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:55:58.033603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:55:58.033603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:55:58.033603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:55:58.033603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:55:58.033603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:55:58.033603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:55:58.033603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:55:58.033603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:55:58.033603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:55:58.033603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:55:58.033603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:55:58.033603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:55:58.033603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:55:58.034519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:55:58.034519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:55:58.034519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:55:58.034519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:55:58.034519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:55:58.034519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:55:58.034519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:55:58.034519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:55:58.034519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:55:58.034519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:55:58.034519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:55:58.034519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:55:58.034519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:55:58.034519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:55:58.034519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:55:58.034519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:55:58.035329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:55:58.035329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:55:58.035329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:55:58.035329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:55:58.035329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:55:58.035329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:55:58.035329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:55:58.035329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:55:58.035329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:55:58.035329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:55:58.035329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:55:58.035329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:55:58.035329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 117/229] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:55:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:55:58.036746 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d4091-b89d-4fd4-b9ae-63af0a341b56 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:58.042342 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645b9b9-8caa-427d-b83f-fba876aee4d4 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:58.087057 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:58.103700 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac2d67-bdec-49a5-967b-b8307a2aa58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:58.104632 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac2d67-bdec-49a5-967b-b8307a2aa58a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:58.104952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac2d67-bdec-49a5-967b-b8307a2aa58a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:58.105225 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac2d67-bdec-49a5-967b-b8307a2aa58a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:58.106794 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac2d67-bdec-49a5-967b-b8307a2aa58a None admin] RBAC: Adding query filter params (role.id=a4345a1838084e3494c3e85dfb3225b4, scope.project.id=048e800f61d84e729c209484f6bd0635, user.id=3856f2405b0841298f960d48de3bf187) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:58.107117 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac2d67-bdec-49a5-967b-b8307a2aa58a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:58.108958 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac2d67-bdec-49a5-967b-b8307a2aa58a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:58.114626 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 113/230] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:55:57 2022] GET /identity/v3/role_assignments?user.id=3856f2405b0841298f960d48de3bf187&scope.project.id=048e800f61d84e729c209484f6bd0635&role.id=a4345a1838084e3494c3e85dfb3225b4 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:58.120615 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:58.156186 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645b9b9-8caa-427d-b83f-fba876aee4d4 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:58.195785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69ac74-d1e6-4e41-a9b0-ccaf0dcc7ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:58.196525 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69ac74-d1e6-4e41-a9b0-ccaf0dcc7ec3 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:58.196814 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69ac74-d1e6-4e41-a9b0-ccaf0dcc7ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:58.197088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69ac74-d1e6-4e41-a9b0-ccaf0dcc7ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:58.197842 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69ac74-d1e6-4e41-a9b0-ccaf0dcc7ec3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:55:58.198145 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69ac74-d1e6-4e41-a9b0-ccaf0dcc7ec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:58.199581 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69ac74-d1e6-4e41-a9b0-ccaf0dcc7ec3 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:58.209564 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 118/231] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:55:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:55:58.216444 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac2d67-bdec-49a5-967b-b8307a2aa58a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:58.360742 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac2d67-bdec-49a5-967b-b8307a2aa58a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:58.408463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8064c3-747c-4fef-8ba7-8757d1369f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:58.409337 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8064c3-747c-4fef-8ba7-8757d1369f71 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:58.409620 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8064c3-747c-4fef-8ba7-8757d1369f71 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:58.409890 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8064c3-747c-4fef-8ba7-8757d1369f71 None admin] PATH_INFO: `/v3/users/4ab8b62c8a994dd1aa089fd0d50368ce` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:58.411117 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8064c3-747c-4fef-8ba7-8757d1369f71 None admin] RBAC: Authorizing `identity:get_user(user_id=4ab8b62c8a994dd1aa089fd0d50368ce)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:58.412577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8064c3-747c-4fef-8ba7-8757d1369f71 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:58.414203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 114/232] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:55:58 2022] GET /identity/v3/users/4ab8b62c8a994dd1aa089fd0d50368ce => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:58.420258 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69ac74-d1e6-4e41-a9b0-ccaf0dcc7ec3 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:58.548130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69ac74-d1e6-4e41-a9b0-ccaf0dcc7ec3 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:58.584439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3cc03-4c48-4a15-88eb-6ee6d8705abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:58.585332 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3cc03-4c48-4a15-88eb-6ee6d8705abe None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:58.585698 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3cc03-4c48-4a15-88eb-6ee6d8705abe None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:58.585976 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3cc03-4c48-4a15-88eb-6ee6d8705abe None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:58.587206 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3cc03-4c48-4a15-88eb-6ee6d8705abe None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:58.588700 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3cc03-4c48-4a15-88eb-6ee6d8705abe None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:58.590431 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 119/233] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:55:58 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:55:58.596925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8064c3-747c-4fef-8ba7-8757d1369f71 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:58.655577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:58.702842 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8064c3-747c-4fef-8ba7-8757d1369f71 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:55:58.738246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46189a1-baf6-495e-a595-50f14466259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:55:58.739413 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46189a1-baf6-495e-a595-50f14466259c None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:58.739862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46189a1-baf6-495e-a595-50f14466259c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:58.740273 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46189a1-baf6-495e-a595-50f14466259c None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635/users/4ab8b62c8a994dd1aa089fd0d50368ce/roles/7b0becbc0d8a464b83a0b90da1e48a67` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:58.742729 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46189a1-baf6-495e-a595-50f14466259c None admin] RBAC: Authorizing `identity:create_grant(project_id=048e800f61d84e729c209484f6bd0635, user_id=4ab8b62c8a994dd1aa089fd0d50368ce, role_id=7b0becbc0d8a464b83a0b90da1e48a67)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:55:58.744308 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46189a1-baf6-495e-a595-50f14466259c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:55:58.771363 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 115/234] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Jul 11 11:55:58 2022] PUT /identity/v3/projects/048e800f61d84e729c209484f6bd0635/users/4ab8b62c8a994dd1aa089fd0d50368ce/roles/7b0becbc0d8a464b83a0b90da1e48a67 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:55:59.753864 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ed2e6-4322-48b2-aa7e-fbcf4ff09b04 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:59.754935 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ed2e6-4322-48b2-aa7e-fbcf4ff09b04 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:59.755445 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ed2e6-4322-48b2-aa7e-fbcf4ff09b04 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:59.757299 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 120/235] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:55:59.763468 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0f323-d247-49d1-8952-da715433ebca None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:59.764274 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0f323-d247-49d1-8952-da715433ebca None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:59.764767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0f323-d247-49d1-8952-da715433ebca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:59.791681 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b1c0f323-d247-49d1-8952-da715433ebca None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:59.793187 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b1c0f323-d247-49d1-8952-da715433ebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:59.808600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd935e-ec9b-473a-94e4-ce065e55bb41 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:59.809290 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd935e-ec9b-473a-94e4-ce065e55bb41 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:59.809883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd935e-ec9b-473a-94e4-ce065e55bb41 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:59.812025 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 121/236] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:55:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:55:59.820118 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f016-383c-41ca-9213-eaed63be8c8d None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:55:59.820948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f016-383c-41ca-9213-eaed63be8c8d None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:55:59.821444 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f016-383c-41ca-9213-eaed63be8c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:55:59.830653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:55:59.845710 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-7146f016-383c-41ca-9213-eaed63be8c8d None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:55:59.847041 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-7146f016-383c-41ca-9213-eaed63be8c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:55:59.893333 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 116/237] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:59.920713 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0f323-d247-49d1-8952-da715433ebca None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:55:59.954417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 122/238] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:55:59.998229 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:00.026854 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146f016-383c-41ca-9213-eaed63be8c8d None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:00.108987 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0f323-d247-49d1-8952-da715433ebca None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:00.182098 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146f016-383c-41ca-9213-eaed63be8c8d None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:00.207964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124099a-7541-4d48-af13-2f325d5a1e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:00.208768 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124099a-7541-4d48-af13-2f325d5a1e28 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:00.209049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124099a-7541-4d48-af13-2f325d5a1e28 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:00.209322 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124099a-7541-4d48-af13-2f325d5a1e28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:00.213808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:00.216035 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124099a-7541-4d48-af13-2f325d5a1e28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:00.217701 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124099a-7541-4d48-af13-2f325d5a1e28 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:00.223682 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 117/239] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:55:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:00.225959 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124099a-7541-4d48-af13-2f325d5a1e28 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:00.227285 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805875e-1b15-490a-9396-2b88e3cff73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:00.228306 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805875e-1b15-490a-9396-2b88e3cff73a None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:00.229064 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805875e-1b15-490a-9396-2b88e3cff73a None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:00.229546 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805875e-1b15-490a-9396-2b88e3cff73a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:00.241966 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805875e-1b15-490a-9396-2b88e3cff73a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:00.250313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-d805875e-1b15-490a-9396-2b88e3cff73a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:56:00.250313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:00.250313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:00.250313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:00.250313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:00.250313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:00.250313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:00.250313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:00.250313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:00.250313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:00.250313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:00.250313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:00.250313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:00.250313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:00.250313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:00.250313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:00.251197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:00.251197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:00.251197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:00.251197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:00.251197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:00.251197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:00.251197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:00.251197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:00.251197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:00.251197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:00.251197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:00.251197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:00.251197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:00.251197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:00.251197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:00.251197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:00.251970 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:00.251970 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:00.251970 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:00.251970 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:00.251970 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:00.251970 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:00.251970 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:00.251970 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:00.251970 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:00.251970 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:00.251970 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:56:00.251970 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:00.254348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 123/240] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:00.261981 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805875e-1b15-490a-9396-2b88e3cff73a None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:00.415616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124099a-7541-4d48-af13-2f325d5a1e28 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:00.432779 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:00.471199 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa06a5-d04f-46d7-9a66-b5aa6e845419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:00.472261 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa06a5-d04f-46d7-9a66-b5aa6e845419 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:00.474152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa06a5-d04f-46d7-9a66-b5aa6e845419 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:00.474628 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa06a5-d04f-46d7-9a66-b5aa6e845419 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:00.475675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa06a5-d04f-46d7-9a66-b5aa6e845419 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:00.478375 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa06a5-d04f-46d7-9a66-b5aa6e845419 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:00.491643 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805875e-1b15-490a-9396-2b88e3cff73a None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:00.539516 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 118/241] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Jul 11 11:56:00 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:56:00.541194 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d69a9-3dbb-4f94-ade2-af3738b63e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:00.542150 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d69a9-3dbb-4f94-ade2-af3738b63e76 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:00.542739 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d69a9-3dbb-4f94-ade2-af3738b63e76 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:00.543260 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d69a9-3dbb-4f94-ade2-af3738b63e76 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:00.544691 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d69a9-3dbb-4f94-ade2-af3738b63e76 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:00.545237 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d69a9-3dbb-4f94-ade2-af3738b63e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:00.546924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d69a9-3dbb-4f94-ade2-af3738b63e76 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:00.556785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 124/242] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:00.562794 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa06a5-d04f-46d7-9a66-b5aa6e845419 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:00.568618 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f768c-bdce-4046-b359-166af4fc9946 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:00.569234 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f768c-bdce-4046-b359-166af4fc9946 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:00.569773 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f768c-bdce-4046-b359-166af4fc9946 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:00.578006 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 125/243] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:00 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:00.584410 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c62735-e415-4d90-b326-ff92d60daf7a None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:00.585071 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c62735-e415-4d90-b326-ff92d60daf7a None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:00.585609 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c62735-e415-4d90-b326-ff92d60daf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:00.613857 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-90c62735-e415-4d90-b326-ff92d60daf7a None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:00.615188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-90c62735-e415-4d90-b326-ff92d60daf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:00.716403 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:00.733494 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa06a5-d04f-46d7-9a66-b5aa6e845419 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:00.756529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 126/244] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:00.770913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f449ea-bf87-471a-8a9c-983fdcdc2fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:00.771814 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f449ea-bf87-471a-8a9c-983fdcdc2fd5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:00.772099 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f449ea-bf87-471a-8a9c-983fdcdc2fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:00.772375 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f449ea-bf87-471a-8a9c-983fdcdc2fd5 None admin] PATH_INFO: `/v3/users/fe6a8dacedc04489a70e589886abf4e7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:00.789488 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f449ea-bf87-471a-8a9c-983fdcdc2fd5 None admin] RBAC: Authorizing `identity:get_user(user_id=fe6a8dacedc04489a70e589886abf4e7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:00.791019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f449ea-bf87-471a-8a9c-983fdcdc2fd5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:00.792775 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 119/245] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:56:00 2022] GET /identity/v3/users/fe6a8dacedc04489a70e589886abf4e7 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:00.796700 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c62735-e415-4d90-b326-ff92d60daf7a None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:00.798880 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f449ea-bf87-471a-8a9c-983fdcdc2fd5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:00.828147 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:00.907882 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f449ea-bf87-471a-8a9c-983fdcdc2fd5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:00.934239 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c62735-e415-4d90-b326-ff92d60daf7a None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:00.943970 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66998d-a46e-4e1b-aa3d-db278a9c329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:00.944720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66998d-a46e-4e1b-aa3d-db278a9c329b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:00.945018 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66998d-a46e-4e1b-aa3d-db278a9c329b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:00.945297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66998d-a46e-4e1b-aa3d-db278a9c329b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:00.987446 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0477cc-4624-4bf5-a1d5-7458499de67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:00.988658 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0477cc-4624-4bf5-a1d5-7458499de67e None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:00.989196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0477cc-4624-4bf5-a1d5-7458499de67e None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:00.989802 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0477cc-4624-4bf5-a1d5-7458499de67e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:01.004993 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0477cc-4624-4bf5-a1d5-7458499de67e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:01.014602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-4e0477cc-4624-4bf5-a1d5-7458499de67e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:56:01.014602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:01.014602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:01.014602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:01.014602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:01.014602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:01.014602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:01.014602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:01.014602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:01.014602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:01.014602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:01.014602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:01.014602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:01.014602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:01.014602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:01.014602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:01.015536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:01.015536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:01.015536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:01.015536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:01.015536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:01.015536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:01.015536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:01.015536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:01.015536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:01.015536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:01.015536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:01.015536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:01.015536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:01.015536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:01.015536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:01.015536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:01.016394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:01.016394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:01.016394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:01.016394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:01.016394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:01.016394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:01.016394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:01.016394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:01.016394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:01.016394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:01.016394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:56:01.016394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:01.019885 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 127/246] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:56:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:01.020632 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66998d-a46e-4e1b-aa3d-db278a9c329b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:01.022133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66998d-a46e-4e1b-aa3d-db278a9c329b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:01.025258 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0477cc-4624-4bf5-a1d5-7458499de67e None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:01.050361 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:01.099530 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:01.162638 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 120/247] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 11:56:01.175071 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0477cc-4624-4bf5-a1d5-7458499de67e None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:01.178891 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66998d-a46e-4e1b-aa3d-db278a9c329b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:01.225931 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2af98-53a6-44bf-9741-694eeea1b298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:01.226650 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2af98-53a6-44bf-9741-694eeea1b298 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:01.227047 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2af98-53a6-44bf-9741-694eeea1b298 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:01.227357 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2af98-53a6-44bf-9741-694eeea1b298 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:01.228135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2af98-53a6-44bf-9741-694eeea1b298 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:01.228462 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2af98-53a6-44bf-9741-694eeea1b298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:01.230129 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2af98-53a6-44bf-9741-694eeea1b298 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:01.247025 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 128/248] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:01.254535 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2af98-53a6-44bf-9741-694eeea1b298 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:01.350658 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66998d-a46e-4e1b-aa3d-db278a9c329b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:01.379472 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:01.397936 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bfc67-b283-4844-b943-d186c0ecebb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:01.399744 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bfc67-b283-4844-b943-d186c0ecebb3 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:01.399855 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bfc67-b283-4844-b943-d186c0ecebb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:01.400138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bfc67-b283-4844-b943-d186c0ecebb3 None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:01.401895 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bfc67-b283-4844-b943-d186c0ecebb3 None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:01.403953 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bfc67-b283-4844-b943-d186c0ecebb3 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:01.405940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 121/249] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:01 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:01.411624 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2af98-53a6-44bf-9741-694eeea1b298 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:01.415194 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a873c-1299-4b2e-93f6-9f25540b6649 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:01.415396 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a873c-1299-4b2e-93f6-9f25540b6649 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:01.415638 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a873c-1299-4b2e-93f6-9f25540b6649 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:01.416992 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 122/250] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:01.426807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a873c-1299-4b2e-93f6-9f25540b6649 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:01.427927 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:01.470552 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbecf98-80f9-4ccb-b60b-c456fdb9465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:01.471485 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbecf98-80f9-4ccb-b60b-c456fdb9465a None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:01.471765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbecf98-80f9-4ccb-b60b-c456fdb9465a None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:01.472125 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbecf98-80f9-4ccb-b60b-c456fdb9465a None admin] PATH_INFO: `/v3/users/4ab8b62c8a994dd1aa089fd0d50368ce` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:01.473341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbecf98-80f9-4ccb-b60b-c456fdb9465a None admin] RBAC: Authorizing `identity:get_user(user_id=4ab8b62c8a994dd1aa089fd0d50368ce)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:01.474842 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbecf98-80f9-4ccb-b60b-c456fdb9465a None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:01.476881 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 129/251] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:56:01 2022] GET /identity/v3/users/4ab8b62c8a994dd1aa089fd0d50368ce => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:01.478164 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c31d9-881c-446e-8429-b8b8737cdc07 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:01.478448 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c31d9-881c-446e-8429-b8b8737cdc07 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:01.479112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c31d9-881c-446e-8429-b8b8737cdc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:01.496424 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-677c31d9-881c-446e-8429-b8b8737cdc07 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:01.498321 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-677c31d9-881c-446e-8429-b8b8737cdc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:01.610802 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 130/252] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:01.611722 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c31d9-881c-446e-8429-b8b8737cdc07 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:01.661017 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a873c-1299-4b2e-93f6-9f25540b6649 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:01.729986 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f2f17-305d-4abe-9b72-5b400fdc3bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:01.730644 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f2f17-305d-4abe-9b72-5b400fdc3bd3 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:01.730948 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f2f17-305d-4abe-9b72-5b400fdc3bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:01.731797 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f2f17-305d-4abe-9b72-5b400fdc3bd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:01.732619 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f2f17-305d-4abe-9b72-5b400fdc3bd3 None admin] RBAC: Adding query filter params (role.id=e31991ec4dc346aca330fca5d28c258f, scope.project.id=048e800f61d84e729c209484f6bd0635, user.id=fe6a8dacedc04489a70e589886abf4e7) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:01.732929 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f2f17-305d-4abe-9b72-5b400fdc3bd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:01.734641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f2f17-305d-4abe-9b72-5b400fdc3bd3 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:01.748962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 123/253] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:56:01 2022] GET /identity/v3/role_assignments?user.id=fe6a8dacedc04489a70e589886abf4e7&scope.project.id=048e800f61d84e729c209484f6bd0635&role.id=e31991ec4dc346aca330fca5d28c258f => generated 259 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:01.749580 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f2f17-305d-4abe-9b72-5b400fdc3bd3 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:01.778789 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c31d9-881c-446e-8429-b8b8737cdc07 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:01.781990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:01.821412 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f89e9-2c97-48ad-86c8-7372f441cf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:01.822076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f89e9-2c97-48ad-86c8-7372f441cf03 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:01.822359 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f89e9-2c97-48ad-86c8-7372f441cf03 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:01.822639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f89e9-2c97-48ad-86c8-7372f441cf03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:01.900775 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f89e9-2c97-48ad-86c8-7372f441cf03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:01.902300 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f89e9-2c97-48ad-86c8-7372f441cf03 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:01.904902 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:02.004474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f2f17-305d-4abe-9b72-5b400fdc3bd3 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:02.017328 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 131/254] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:02.018674 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6494d-637e-45e2-ba4a-b276ac4cb3c5 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:02.019394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6494d-637e-45e2-ba4a-b276ac4cb3c5 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:02.019696 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6494d-637e-45e2-ba4a-b276ac4cb3c5 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:02.020977 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 132/255] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:02.026071 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6494d-637e-45e2-ba4a-b276ac4cb3c5 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:02.031643 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:02.057710 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7cebc-fe2a-4529-b7bf-df9ea484362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:02.058660 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7cebc-fe2a-4529-b7bf-df9ea484362e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:02.060239 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7cebc-fe2a-4529-b7bf-df9ea484362e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:02.060527 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7cebc-fe2a-4529-b7bf-df9ea484362e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:02.075976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7cebc-fe2a-4529-b7bf-df9ea484362e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:02.086479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-7ef7cebc-fe2a-4529-b7bf-df9ea484362e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:02.086479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:02.086479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:02.086479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:02.086479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:02.086479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:02.086479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:02.086479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:02.086479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:02.086479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:02.086479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:02.086479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:02.086479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:02.086479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:02.086479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:02.086479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:02.087378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:02.087378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:02.087378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:02.087378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:02.087378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:02.087378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:02.087378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:02.087378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:02.087378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:02.087378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:02.087378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:02.087378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:02.087378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:02.087378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:02.087378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:02.087378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:02.088578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:02.088578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:02.088578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:02.088578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:02.088578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:02.088578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:02.088578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:02.088578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:02.088578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:02.088578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:02.088578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:02.088578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:02.088578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 124/256] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:02.090742 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df9f7d-d6b1-4c23-8f0b-cfe67a66f862 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:02.090742 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df9f7d-d6b1-4c23-8f0b-cfe67a66f862 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:02.090742 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df9f7d-d6b1-4c23-8f0b-cfe67a66f862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:02.111087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-80df9f7d-d6b1-4c23-8f0b-cfe67a66f862 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:02.112553 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-80df9f7d-d6b1-4c23-8f0b-cfe67a66f862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:02.209484 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6494d-637e-45e2-ba4a-b276ac4cb3c5 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:02.227542 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 125/257] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:02.228415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df9f7d-d6b1-4c23-8f0b-cfe67a66f862 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:02.285497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21c7cb-db29-4e3f-99ec-6c5a24761ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:02.286295 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21c7cb-db29-4e3f-99ec-6c5a24761ec6 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:02.286576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21c7cb-db29-4e3f-99ec-6c5a24761ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:02.286873 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21c7cb-db29-4e3f-99ec-6c5a24761ec6 None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:02.288198 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21c7cb-db29-4e3f-99ec-6c5a24761ec6 None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:02.289697 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21c7cb-db29-4e3f-99ec-6c5a24761ec6 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:02.294067 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 133/258] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:02 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:02.295649 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21c7cb-db29-4e3f-99ec-6c5a24761ec6 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:02.304211 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:02.402547 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df9f7d-d6b1-4c23-8f0b-cfe67a66f862 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:02.429716 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:02.464695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21c7cb-db29-4e3f-99ec-6c5a24761ec6 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:02.482049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a82e40-20cb-4d51-9130-646e14cf280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:02.482855 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a82e40-20cb-4d51-9130-646e14cf280f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:02.483148 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a82e40-20cb-4d51-9130-646e14cf280f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:02.483427 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a82e40-20cb-4d51-9130-646e14cf280f None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:02.484185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a82e40-20cb-4d51-9130-646e14cf280f None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:02.484491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a82e40-20cb-4d51-9130-646e14cf280f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:02.485893 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a82e40-20cb-4d51-9130-646e14cf280f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:02.500058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 126/259] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:02.500876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a82e40-20cb-4d51-9130-646e14cf280f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:02.515439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43565a84-b7d5-4464-8809-780bccdefe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:02.516256 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43565a84-b7d5-4464-8809-780bccdefe72 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:02.516537 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43565a84-b7d5-4464-8809-780bccdefe72 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:02.516808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43565a84-b7d5-4464-8809-780bccdefe72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:02.540095 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43565a84-b7d5-4464-8809-780bccdefe72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:02.551467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-43565a84-b7d5-4464-8809-780bccdefe72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:56:02.551467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:02.551467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:02.551467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:02.551467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:02.551467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:02.551467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:02.551467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:02.551467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:02.551467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:02.551467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:02.551467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:02.551467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:02.551467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:02.551467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:02.551467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:02.552370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:02.552370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:02.552370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:02.552370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:02.552370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:02.552370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:02.552370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:02.552370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:02.552370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:02.552370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:02.552370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:02.552370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:02.552370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:02.552370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:02.552370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:02.552370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:02.553225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:02.553225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:02.553225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:02.553225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:02.553225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:02.553225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:02.553225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:02.553225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:02.553225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:02.553225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:02.553225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:56:02.553225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:02.557335 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 134/260] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:56:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:02.560601 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43565a84-b7d5-4464-8809-780bccdefe72 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:02.672055 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43565a84-b7d5-4464-8809-780bccdefe72 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:02.684411 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a82e40-20cb-4d51-9130-646e14cf280f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:02.703073 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:02.703647 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:02.711167 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4167749-775e-4c89-bc9a-10749ea5bf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:02.712430 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4167749-775e-4c89-bc9a-10749ea5bf13 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:02.712917 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4167749-775e-4c89-bc9a-10749ea5bf13 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:02.713409 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4167749-775e-4c89-bc9a-10749ea5bf13 None admin] PATH_INFO: `/v3/users/3856f2405b0841298f960d48de3bf187` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:02.714868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4167749-775e-4c89-bc9a-10749ea5bf13 None admin] RBAC: Authorizing `identity:get_user(user_id=3856f2405b0841298f960d48de3bf187)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:02.718314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4167749-775e-4c89-bc9a-10749ea5bf13 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:02.720246 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 135/261] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:56:02 2022] GET /identity/v3/users/3856f2405b0841298f960d48de3bf187 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:02.721216 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4167749-775e-4c89-bc9a-10749ea5bf13 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:02.754314 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584626f-d639-431b-8e01-8a1bcaa4834f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:02.756265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584626f-d639-431b-8e01-8a1bcaa4834f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:02.759067 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584626f-d639-431b-8e01-8a1bcaa4834f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:02.759552 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584626f-d639-431b-8e01-8a1bcaa4834f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:02.760637 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584626f-d639-431b-8e01-8a1bcaa4834f None admin] RBAC: Adding query filter params (role.id=11fc9dc7c3664b2b8af8eee2462707b8, scope.project.id=048e800f61d84e729c209484f6bd0635, user.id=4ab8b62c8a994dd1aa089fd0d50368ce) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:02.761165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584626f-d639-431b-8e01-8a1bcaa4834f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:02.763754 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584626f-d639-431b-8e01-8a1bcaa4834f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:02.777036 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 127/262] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:56:02 2022] GET /identity/v3/role_assignments?user.id=4ab8b62c8a994dd1aa089fd0d50368ce&scope.project.id=048e800f61d84e729c209484f6bd0635&role.id=11fc9dc7c3664b2b8af8eee2462707b8 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:02.780326 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584626f-d639-431b-8e01-8a1bcaa4834f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:02.917259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4167749-775e-4c89-bc9a-10749ea5bf13 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:02.946799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584626f-d639-431b-8e01-8a1bcaa4834f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:02.986857 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a986a-2830-4160-ba4d-199defe03319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:02.988109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a986a-2830-4160-ba4d-199defe03319 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:02.988590 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a986a-2830-4160-ba4d-199defe03319 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:02.989059 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a986a-2830-4160-ba4d-199defe03319 None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:02.990523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a986a-2830-4160-ba4d-199defe03319 None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:02.992548 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a986a-2830-4160-ba4d-199defe03319 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:02.994820 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 128/263] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:02 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:03.002113 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bcc40-3fca-45f2-b708-355cdf3baf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:03.002851 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bcc40-3fca-45f2-b708-355cdf3baf06 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:03.003107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a986a-2830-4160-ba4d-199defe03319 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:03.003209 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bcc40-3fca-45f2-b708-355cdf3baf06 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:03.003409 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bcc40-3fca-45f2-b708-355cdf3baf06 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:03.004176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bcc40-3fca-45f2-b708-355cdf3baf06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:03.004488 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bcc40-3fca-45f2-b708-355cdf3baf06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:03.005892 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bcc40-3fca-45f2-b708-355cdf3baf06 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:03.014892 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 136/264] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:03.020503 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bcc40-3fca-45f2-b708-355cdf3baf06 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:03.101140 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:03.156015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:03.215090 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a986a-2830-4160-ba4d-199defe03319 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:03.234075 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bcc40-3fca-45f2-b708-355cdf3baf06 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:03.284040 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa571bfc-a680-463c-81be-03f945136e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:03.284927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa571bfc-a680-463c-81be-03f945136e13 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:03.285206 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa571bfc-a680-463c-81be-03f945136e13 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:03.285479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa571bfc-a680-463c-81be-03f945136e13 None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635/users/3856f2405b0841298f960d48de3bf187/roles/a4345a1838084e3494c3e85dfb3225b4` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:03.288736 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa571bfc-a680-463c-81be-03f945136e13 None admin] RBAC: Authorizing `identity:create_grant(project_id=048e800f61d84e729c209484f6bd0635, user_id=3856f2405b0841298f960d48de3bf187, role_id=a4345a1838084e3494c3e85dfb3225b4)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:03.290967 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa571bfc-a680-463c-81be-03f945136e13 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:03.298132 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aeb3fd-1b9f-4db2-80ad-0afe0251aa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:03.299054 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeb3fd-1b9f-4db2-80ad-0afe0251aa46 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:03.299337 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeb3fd-1b9f-4db2-80ad-0afe0251aa46 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:03.299608 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeb3fd-1b9f-4db2-80ad-0afe0251aa46 None admin] PATH_INFO: `/v3/users/4ab8b62c8a994dd1aa089fd0d50368ce` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:03.302339 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aeb3fd-1b9f-4db2-80ad-0afe0251aa46 None admin] RBAC: Authorizing `identity:get_user(user_id=4ab8b62c8a994dd1aa089fd0d50368ce)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:03.303865 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aeb3fd-1b9f-4db2-80ad-0afe0251aa46 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:03.305982 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 137/265] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:56:03 2022] GET /identity/v3/users/4ab8b62c8a994dd1aa089fd0d50368ce => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:03.313489 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aeb3fd-1b9f-4db2-80ad-0afe0251aa46 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:03.328507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 129/266] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Jul 11 11:56:03 2022] PUT /identity/v3/projects/048e800f61d84e729c209484f6bd0635/users/3856f2405b0841298f960d48de3bf187/roles/a4345a1838084e3494c3e85dfb3225b4 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:56:03.442045 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aeb3fd-1b9f-4db2-80ad-0afe0251aa46 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:03.479403 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:03.489265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe1fc1-54be-4934-8607-9d2675908782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:03.490323 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe1fc1-54be-4934-8607-9d2675908782 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:03.490847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe1fc1-54be-4934-8607-9d2675908782 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:03.491325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe1fc1-54be-4934-8607-9d2675908782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:03.567413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe1fc1-54be-4934-8607-9d2675908782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:03.569266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe1fc1-54be-4934-8607-9d2675908782 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:03.667484 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb8111-f7f4-4e52-b121-2e3563c145ea None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:03.667803 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb8111-f7f4-4e52-b121-2e3563c145ea None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:03.668053 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb8111-f7f4-4e52-b121-2e3563c145ea None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:03.671014 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 130/267] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:03.677340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ae124-147d-42c7-91a0-dc88a884035c None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:03.677634 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ae124-147d-42c7-91a0-dc88a884035c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:03.677918 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ae124-147d-42c7-91a0-dc88a884035c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:03.696756 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 138/268] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:03.701704 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d95ae124-147d-42c7-91a0-dc88a884035c None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:03.702588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe1fc1-54be-4934-8607-9d2675908782 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:03.702960 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d95ae124-147d-42c7-91a0-dc88a884035c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:03.739070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:03.828752 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 131/269] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:03.847814 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe1fc1-54be-4934-8607-9d2675908782 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:03.872763 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ae124-147d-42c7-91a0-dc88a884035c None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:03.893731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20460c83-7562-4a36-8d8e-6b437cf0de4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:03.894611 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20460c83-7562-4a36-8d8e-6b437cf0de4a None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:03.894917 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20460c83-7562-4a36-8d8e-6b437cf0de4a None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:03.895191 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20460c83-7562-4a36-8d8e-6b437cf0de4a None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:03.896539 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20460c83-7562-4a36-8d8e-6b437cf0de4a None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:03.898015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20460c83-7562-4a36-8d8e-6b437cf0de4a None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:03.900042 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 139/270] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:03 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:03.907051 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20460c83-7562-4a36-8d8e-6b437cf0de4a None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:03.943629 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:04.039239 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:04.043117 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20460c83-7562-4a36-8d8e-6b437cf0de4a None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:04.081160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ae124-147d-42c7-91a0-dc88a884035c None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:04.093265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138e836-8fa7-47d5-958a-883a1c02d524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:04.094354 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138e836-8fa7-47d5-958a-883a1c02d524 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:04.094861 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138e836-8fa7-47d5-958a-883a1c02d524 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:04.095328 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138e836-8fa7-47d5-958a-883a1c02d524 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:04.096364 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138e836-8fa7-47d5-958a-883a1c02d524 None admin] RBAC: Adding query filter params (role.id=7b0becbc0d8a464b83a0b90da1e48a67, scope.project.id=048e800f61d84e729c209484f6bd0635, user.id=4ab8b62c8a994dd1aa089fd0d50368ce) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:04.096964 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138e836-8fa7-47d5-958a-883a1c02d524 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:04.098696 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138e836-8fa7-47d5-958a-883a1c02d524 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:04.106983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 140/271] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:56:03 2022] GET /identity/v3/role_assignments?user.id=4ab8b62c8a994dd1aa089fd0d50368ce&scope.project.id=048e800f61d84e729c209484f6bd0635&role.id=7b0becbc0d8a464b83a0b90da1e48a67 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:04.108767 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e5f5-cdad-4374-9b0c-3c9684e797de None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:04.109270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e5f5-cdad-4374-9b0c-3c9684e797de None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:04.109754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6e5f5-cdad-4374-9b0c-3c9684e797de None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:04.111345 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 141/272] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:04.117528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c12e6-7d13-44fb-8da9-227403695233 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:04.118115 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c12e6-7d13-44fb-8da9-227403695233 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:04.118619 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c12e6-7d13-44fb-8da9-227403695233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:04.139802 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-5c7c12e6-7d13-44fb-8da9-227403695233 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:04.141429 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-5c7c12e6-7d13-44fb-8da9-227403695233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:04.143482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467cb3a-ce8c-49ea-984e-a93722dfb3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:04.144320 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467cb3a-ce8c-49ea-984e-a93722dfb3d4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:04.144606 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467cb3a-ce8c-49ea-984e-a93722dfb3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:04.144884 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467cb3a-ce8c-49ea-984e-a93722dfb3d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:04.169855 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467cb3a-ce8c-49ea-984e-a93722dfb3d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:04.187030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-2467cb3a-ce8c-49ea-984e-a93722dfb3d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:04.187030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:04.187030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:04.187030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:04.187030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:04.187030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:04.187030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:04.187030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:04.187030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:04.187030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:04.187030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:04.187030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:04.187030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:04.187030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:04.187030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:04.187030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:04.188012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:04.188012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:04.188012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:04.188012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:04.188012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:04.188012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:04.188012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:04.188012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:04.188012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:04.188012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:04.188012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:04.188012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:04.188012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:04.188012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:04.188012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:04.188012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:04.188778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:04.188778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:04.188778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:04.188778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:04.188778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:04.188778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:04.188778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:04.188778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:04.188778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:04.188778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:04.188778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:04.188778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:04.195236 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 132/273] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:04.202419 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467cb3a-ce8c-49ea-984e-a93722dfb3d4 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:04.228205 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 142/274] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:04.256860 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c12e6-7d13-44fb-8da9-227403695233 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:04.338697 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:04.359331 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467cb3a-ce8c-49ea-984e-a93722dfb3d4 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:04.412015 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53936b-e7eb-496e-a41e-c6599a72e2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:04.413196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53936b-e7eb-496e-a41e-c6599a72e2f5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:04.413683 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53936b-e7eb-496e-a41e-c6599a72e2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:04.414322 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53936b-e7eb-496e-a41e-c6599a72e2f5 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:04.414974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:04.415567 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53936b-e7eb-496e-a41e-c6599a72e2f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:04.416374 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53936b-e7eb-496e-a41e-c6599a72e2f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:04.418548 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53936b-e7eb-496e-a41e-c6599a72e2f5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:04.429258 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c12e6-7d13-44fb-8da9-227403695233 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:04.431409 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 133/275] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:04.437558 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53936b-e7eb-496e-a41e-c6599a72e2f5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:04.476560 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417dce9-fd0c-4767-a80a-d4f46597fbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:04.477803 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417dce9-fd0c-4767-a80a-d4f46597fbe2 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:04.478160 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417dce9-fd0c-4767-a80a-d4f46597fbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:04.478503 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417dce9-fd0c-4767-a80a-d4f46597fbe2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:04.482764 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417dce9-fd0c-4767-a80a-d4f46597fbe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:04.482764 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417dce9-fd0c-4767-a80a-d4f46597fbe2 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:04.483834 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 143/276] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:04.489553 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417dce9-fd0c-4767-a80a-d4f46597fbe2 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:04.605116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53936b-e7eb-496e-a41e-c6599a72e2f5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:04.642972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417dce9-fd0c-4767-a80a-d4f46597fbe2 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:04.663104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6288556-afe8-4acc-8489-050c9b43a637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:04.664881 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6288556-afe8-4acc-8489-050c9b43a637 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:04.665347 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6288556-afe8-4acc-8489-050c9b43a637 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:04.665820 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6288556-afe8-4acc-8489-050c9b43a637 None admin] PATH_INFO: `/v3/users/eddde9cc8765489da331aea3ac6cda8b` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:04.683796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6288556-afe8-4acc-8489-050c9b43a637 None admin] RBAC: Authorizing `identity:get_user(user_id=eddde9cc8765489da331aea3ac6cda8b)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:04.686004 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6288556-afe8-4acc-8489-050c9b43a637 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:04.686182 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375ea54-76c2-454c-b6c0-3dc16b963560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:04.686995 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375ea54-76c2-454c-b6c0-3dc16b963560 None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:04.687345 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375ea54-76c2-454c-b6c0-3dc16b963560 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:04.687686 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375ea54-76c2-454c-b6c0-3dc16b963560 None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:04.688456 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375ea54-76c2-454c-b6c0-3dc16b963560 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:04.688875 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 134/277] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:56:04 2022] GET /identity/v3/users/eddde9cc8765489da331aea3ac6cda8b => generated 293 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:04.690196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375ea54-76c2-454c-b6c0-3dc16b963560 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:04.698635 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6288556-afe8-4acc-8489-050c9b43a637 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:04.716740 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 144/278] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Jul 11 11:56:04 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:56:04.723431 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:04.768656 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6e2a0-24b0-499e-82d1-9e6826bbcd64 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:04.768965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6e2a0-24b0-499e-82d1-9e6826bbcd64 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:04.770851 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6e2a0-24b0-499e-82d1-9e6826bbcd64 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:04.773009 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 145/279] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:04.779385 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94a90c-7a52-446e-9619-ffe0f8d8a264 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:04.780097 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94a90c-7a52-446e-9619-ffe0f8d8a264 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:04.780578 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94a90c-7a52-446e-9619-ffe0f8d8a264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:04.801359 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-9a94a90c-7a52-446e-9619-ffe0f8d8a264 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:04.803668 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-9a94a90c-7a52-446e-9619-ffe0f8d8a264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:04.820991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:04.835084 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6288556-afe8-4acc-8489-050c9b43a637 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:04.876081 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333615-7fe1-4133-ab28-14ef338fc257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:04.876669 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333615-7fe1-4133-ab28-14ef338fc257 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:04.876952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333615-7fe1-4133-ab28-14ef338fc257 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:04.877230 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333615-7fe1-4133-ab28-14ef338fc257 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:04.878070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7333615-7fe1-4133-ab28-14ef338fc257 None admin] RBAC: Adding query filter params (role.id=a4345a1838084e3494c3e85dfb3225b4, user.id=eddde9cc8765489da331aea3ac6cda8b, scope.system=all) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:04.878387 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7333615-7fe1-4133-ab28-14ef338fc257 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:04.880163 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7333615-7fe1-4133-ab28-14ef338fc257 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:04.886684 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 135/280] 10.222.0.25 () {56 vars in 1308 bytes} [Mon Jul 11 11:56:04 2022] GET /identity/v3/role_assignments?user.id=eddde9cc8765489da331aea3ac6cda8b&scope.system=all&role.id=a4345a1838084e3494c3e85dfb3225b4 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:04.900800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 146/281] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:04.925759 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333615-7fe1-4133-ab28-14ef338fc257 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:05.017628 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:05.046333 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333615-7fe1-4133-ab28-14ef338fc257 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:05.085036 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8918b-a0e4-47b4-bc34-726eb92d78ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:05.085838 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8918b-a0e4-47b4-bc34-726eb92d78ef None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:05.086119 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8918b-a0e4-47b4-bc34-726eb92d78ef None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:05.086393 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8918b-a0e4-47b4-bc34-726eb92d78ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:05.097387 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8918b-a0e4-47b4-bc34-726eb92d78ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:05.105464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-c9b8918b-a0e4-47b4-bc34-726eb92d78ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:56:05.105464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:05.105464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:05.105464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:05.105464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:05.105464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:05.105464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:05.105464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:05.105464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:05.105464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:05.105464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:05.105464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:05.105464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:05.105464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:05.105464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:05.105464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:05.107133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:05.107133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:05.107133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:05.107133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:05.107133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:05.107133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:05.107133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:05.107133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:05.107133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:05.107133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:05.107133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:05.107133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:05.107133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:05.107133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:05.107133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:05.107133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:05.107928 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:05.107928 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:05.107928 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:05.107928 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:05.107928 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:05.107928 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:05.107928 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:05.107928 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:05.107928 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:05.107928 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:05.107928 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:56:05.107928 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:05.107928 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 136/282] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:05.114751 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94a90c-7a52-446e-9619-ffe0f8d8a264 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:05.242846 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94a90c-7a52-446e-9619-ffe0f8d8a264 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:05.281896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96a797-6c75-4c09-84c1-bfc485f9ca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:05.282587 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96a797-6c75-4c09-84c1-bfc485f9ca7c None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:05.282908 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96a797-6c75-4c09-84c1-bfc485f9ca7c None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:05.283184 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96a797-6c75-4c09-84c1-bfc485f9ca7c None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:05.283938 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96a797-6c75-4c09-84c1-bfc485f9ca7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:05.284245 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96a797-6c75-4c09-84c1-bfc485f9ca7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:05.285629 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96a797-6c75-4c09-84c1-bfc485f9ca7c None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:05.295463 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 147/283] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:05.301281 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8918b-a0e4-47b4-bc34-726eb92d78ef None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:05.407624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8918b-a0e4-47b4-bc34-726eb92d78ef None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:05.449970 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5c6b8-7b2a-4037-89bb-20425c7508b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:05.450910 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5c6b8-7b2a-4037-89bb-20425c7508b9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:05.451198 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5c6b8-7b2a-4037-89bb-20425c7508b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:05.451547 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5c6b8-7b2a-4037-89bb-20425c7508b9 None admin] PATH_INFO: `/v3/users/fe6a8dacedc04489a70e589886abf4e7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:05.452826 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5c6b8-7b2a-4037-89bb-20425c7508b9 None admin] RBAC: Authorizing `identity:get_user(user_id=fe6a8dacedc04489a70e589886abf4e7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:05.454387 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5c6b8-7b2a-4037-89bb-20425c7508b9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:05.456309 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 137/284] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:56:05 2022] GET /identity/v3/users/fe6a8dacedc04489a70e589886abf4e7 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:05.462574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96a797-6c75-4c09-84c1-bfc485f9ca7c None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:05.475577 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:05.589391 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96a797-6c75-4c09-84c1-bfc485f9ca7c None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:05.636368 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e13fb5-6321-46f5-80d2-18f858a1c166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:05.637792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e13fb5-6321-46f5-80d2-18f858a1c166 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:05.638077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e13fb5-6321-46f5-80d2-18f858a1c166 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:05.638415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e13fb5-6321-46f5-80d2-18f858a1c166 None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:05.639585 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e13fb5-6321-46f5-80d2-18f858a1c166 None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:05.641038 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e13fb5-6321-46f5-80d2-18f858a1c166 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:05.642955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 148/285] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:05 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:05.648942 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5c6b8-7b2a-4037-89bb-20425c7508b9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:05.653590 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:05.759966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5c6b8-7b2a-4037-89bb-20425c7508b9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:05.796442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b0180-e1cf-49f2-86d0-0666724a6869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:05.797356 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b0180-e1cf-49f2-86d0-0666724a6869 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:05.797642 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b0180-e1cf-49f2-86d0-0666724a6869 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:05.797917 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b0180-e1cf-49f2-86d0-0666724a6869 None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635/users/fe6a8dacedc04489a70e589886abf4e7/roles/e31991ec4dc346aca330fca5d28c258f` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:05.800194 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b0180-e1cf-49f2-86d0-0666724a6869 None admin] RBAC: Authorizing `identity:create_grant(project_id=048e800f61d84e729c209484f6bd0635, user_id=fe6a8dacedc04489a70e589886abf4e7, role_id=e31991ec4dc346aca330fca5d28c258f)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:05.802307 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b0180-e1cf-49f2-86d0-0666724a6869 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:05.835760 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 138/286] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Jul 11 11:56:05 2022] PUT /identity/v3/projects/048e800f61d84e729c209484f6bd0635/users/fe6a8dacedc04489a70e589886abf4e7/roles/e31991ec4dc346aca330fca5d28c258f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:56:06.333079 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28a9cf-dca8-48be-96d2-341733fc1563 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:06.333588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28a9cf-dca8-48be-96d2-341733fc1563 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:06.333689 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28a9cf-dca8-48be-96d2-341733fc1563 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:06.335197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 149/287] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:06.342392 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11cff-c1ff-4ab0-9135-94902cfb9412 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:06.342845 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11cff-c1ff-4ab0-9135-94902cfb9412 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:06.343021 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11cff-c1ff-4ab0-9135-94902cfb9412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:06.365686 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-72d11cff-c1ff-4ab0-9135-94902cfb9412 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:06.366946 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-72d11cff-c1ff-4ab0-9135-94902cfb9412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:06.444694 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:06.464408 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 139/288] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:06.508106 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28a9cf-dca8-48be-96d2-341733fc1563 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:06.611167 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:06.644316 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28a9cf-dca8-48be-96d2-341733fc1563 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:06.689690 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13547a6-2cf2-4fb2-8db5-d5892767983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:06.690489 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13547a6-2cf2-4fb2-8db5-d5892767983f None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:06.690799 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13547a6-2cf2-4fb2-8db5-d5892767983f None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:06.691076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13547a6-2cf2-4fb2-8db5-d5892767983f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:06.701664 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13547a6-2cf2-4fb2-8db5-d5892767983f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:06.713397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-a13547a6-2cf2-4fb2-8db5-d5892767983f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:06.713397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:06.713397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:06.713397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:06.713397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:06.713397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:06.713397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:06.713397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:06.713397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:06.713397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:06.713397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:06.713397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:06.713397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:06.713397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:06.713397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:06.713397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:06.714230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:06.714230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:06.714230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:06.714230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:06.714230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:06.714230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:06.714230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:06.714230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:06.714230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:06.714230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:06.714230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:06.714230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:06.714230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:06.714230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:06.714230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:06.714230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:06.715979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:06.715979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:06.715979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:06.715979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:06.715979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:06.715979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:06.715979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:06.715979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:06.715979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:06.715979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:06.715979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:06.715979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:06.715979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 150/289] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:06.720800 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d11cff-c1ff-4ab0-9135-94902cfb9412 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:06.848521 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d11cff-c1ff-4ab0-9135-94902cfb9412 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:06.887483 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bc83e-539a-4b32-a17d-100ff203676c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:06.888655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bc83e-539a-4b32-a17d-100ff203676c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:06.889136 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bc83e-539a-4b32-a17d-100ff203676c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:06.889613 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bc83e-539a-4b32-a17d-100ff203676c None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:06.890867 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bc83e-539a-4b32-a17d-100ff203676c None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:06.891368 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bc83e-539a-4b32-a17d-100ff203676c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:06.892940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bc83e-539a-4b32-a17d-100ff203676c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:06.906991 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 140/290] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:06.912101 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13547a6-2cf2-4fb2-8db5-d5892767983f None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:07.034954 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13547a6-2cf2-4fb2-8db5-d5892767983f None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:07.074188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565619b-1906-45ec-b6f4-933fece97ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:07.075706 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565619b-1906-45ec-b6f4-933fece97ded None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:07.075995 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565619b-1906-45ec-b6f4-933fece97ded None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:07.076270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565619b-1906-45ec-b6f4-933fece97ded None admin] PATH_INFO: `/v3/users/3856f2405b0841298f960d48de3bf187` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:07.077487 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565619b-1906-45ec-b6f4-933fece97ded None admin] RBAC: Authorizing `identity:get_user(user_id=3856f2405b0841298f960d48de3bf187)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:07.078974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565619b-1906-45ec-b6f4-933fece97ded None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:07.080913 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 151/291] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:56:06 2022] GET /identity/v3/users/3856f2405b0841298f960d48de3bf187 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:07.086094 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bc83e-539a-4b32-a17d-100ff203676c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:07.176346 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:07.237414 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bc83e-539a-4b32-a17d-100ff203676c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:07.278651 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29a5a0-5fdc-48a0-bef2-041e9f81dafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:07.279339 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a5a0-5fdc-48a0-bef2-041e9f81dafd None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:07.279625 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a5a0-5fdc-48a0-bef2-041e9f81dafd None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:07.279908 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a5a0-5fdc-48a0-bef2-041e9f81dafd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:07.367584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29a5a0-5fdc-48a0-bef2-041e9f81dafd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:07.368969 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29a5a0-5fdc-48a0-bef2-041e9f81dafd None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:07.431442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:07.476446 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 141/292] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:07.483896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565619b-1906-45ec-b6f4-933fece97ded None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:07.488129 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:07.597381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565619b-1906-45ec-b6f4-933fece97ded None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:07.635915 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af8104-f488-48bd-b1b6-026e5a1e7ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:07.636698 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af8104-f488-48bd-b1b6-026e5a1e7ff2 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:07.637009 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af8104-f488-48bd-b1b6-026e5a1e7ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:07.637282 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af8104-f488-48bd-b1b6-026e5a1e7ff2 None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:07.638566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af8104-f488-48bd-b1b6-026e5a1e7ff2 None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:07.640070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af8104-f488-48bd-b1b6-026e5a1e7ff2 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:07.641817 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 152/293] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:07 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:07.649176 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29a5a0-5fdc-48a0-bef2-041e9f81dafd None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:07.729183 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed485ce8-0d93-48e7-a9e5-b48ff2521754 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:07.729520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed485ce8-0d93-48e7-a9e5-b48ff2521754 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:07.729749 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed485ce8-0d93-48e7-a9e5-b48ff2521754 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:07.731721 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 153/294] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:07.737374 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f0708-8d5d-4741-96a7-09500e1e623f None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:07.737660 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f0708-8d5d-4741-96a7-09500e1e623f None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:07.737939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f0708-8d5d-4741-96a7-09500e1e623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:07.757760 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-0b1f0708-8d5d-4741-96a7-09500e1e623f None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:07.759031 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-0b1f0708-8d5d-4741-96a7-09500e1e623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:07.816916 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29a5a0-5fdc-48a0-bef2-041e9f81dafd None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:07.839798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 154/295] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:07.841226 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02500c78-e6f5-40ea-a452-08ab1a397e8a None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:07.841558 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02500c78-e6f5-40ea-a452-08ab1a397e8a None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:07.841869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02500c78-e6f5-40ea-a452-08ab1a397e8a None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:07.843686 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 155/296] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:07.848873 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a065f84-6461-4ee4-b03b-0a3b458add85 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:07.849165 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a065f84-6461-4ee4-b03b-0a3b458add85 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:07.849444 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a065f84-6461-4ee4-b03b-0a3b458add85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:07.854745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:07.861565 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859c0c5-3d6f-4dcf-8109-0bb66c3368de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:07.862224 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859c0c5-3d6f-4dcf-8109-0bb66c3368de None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:07.862596 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859c0c5-3d6f-4dcf-8109-0bb66c3368de None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:07.862882 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859c0c5-3d6f-4dcf-8109-0bb66c3368de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:07.863768 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859c0c5-3d6f-4dcf-8109-0bb66c3368de None admin] RBAC: Adding query filter params (role.id=a4345a1838084e3494c3e85dfb3225b4, scope.project.id=048e800f61d84e729c209484f6bd0635, user.id=3856f2405b0841298f960d48de3bf187) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:07.864085 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859c0c5-3d6f-4dcf-8109-0bb66c3368de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:07.865549 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859c0c5-3d6f-4dcf-8109-0bb66c3368de None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:07.873211 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 142/297] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:56:07 2022] GET /identity/v3/role_assignments?user.id=3856f2405b0841298f960d48de3bf187&scope.project.id=048e800f61d84e729c209484f6bd0635&role.id=a4345a1838084e3494c3e85dfb3225b4 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:07.876660 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859c0c5-3d6f-4dcf-8109-0bb66c3368de None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:07.880356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-3a065f84-6461-4ee4-b03b-0a3b458add85 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:07.881560 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-3a065f84-6461-4ee4-b03b-0a3b458add85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:07.902485 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:07.984488 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 156/298] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:07.985890 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd79540-2bee-49d3-9563-23c5f8748124 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:07.986184 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd79540-2bee-49d3-9563-23c5f8748124 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:07.986459 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd79540-2bee-49d3-9563-23c5f8748124 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:07.987903 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 157/299] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:08.000257 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63c000-fae1-43a9-ae06-4196e45fa5ed None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:08.000703 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63c000-fae1-43a9-ae06-4196e45fa5ed None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:08.001069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63c000-fae1-43a9-ae06-4196e45fa5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:08.008701 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859c0c5-3d6f-4dcf-8109-0bb66c3368de None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:08.031374 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-cf63c000-fae1-43a9-ae06-4196e45fa5ed None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:08.032980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-cf63c000-fae1-43a9-ae06-4196e45fa5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:08.051296 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05f372-bf0c-4b6f-af83-dfccd1885384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:08.051964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05f372-bf0c-4b6f-af83-dfccd1885384 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:08.052247 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05f372-bf0c-4b6f-af83-dfccd1885384 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:08.052520 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05f372-bf0c-4b6f-af83-dfccd1885384 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:08.066635 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05f372-bf0c-4b6f-af83-dfccd1885384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:08.075152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-1c05f372-bf0c-4b6f-af83-dfccd1885384 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:08.075152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:08.075152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:08.075152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:08.075152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:08.075152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:08.075152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:08.075152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:08.075152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:08.075152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:08.075152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:08.075152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:08.075152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:08.075152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:08.075152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:08.075152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:08.076082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:08.076082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:08.076082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:08.076082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:08.076082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:08.076082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:08.076082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:08.076082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:08.076082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:08.076082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:08.076082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:08.076082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:08.076082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:08.076082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:08.076082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:08.076082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:08.076854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:08.076854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:08.076854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:08.076854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:08.076854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:08.076854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:08.076854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:08.076854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:08.076854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:08.076854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:08.076854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:08.076854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:08.076854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 143/300] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:08.077977 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05f372-bf0c-4b6f-af83-dfccd1885384 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:08.118090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 158/301] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:08.119399 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63c000-fae1-43a9-ae06-4196e45fa5ed None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:08.194521 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:08.198389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:08.217288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05f372-bf0c-4b6f-af83-dfccd1885384 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:08.254588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63c000-fae1-43a9-ae06-4196e45fa5ed None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:08.260211 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468015e9-48ee-48f9-9274-fec182c94c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:08.261008 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468015e9-48ee-48f9-9274-fec182c94c09 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:08.261295 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468015e9-48ee-48f9-9274-fec182c94c09 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:08.261575 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468015e9-48ee-48f9-9274-fec182c94c09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:08.274133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468015e9-48ee-48f9-9274-fec182c94c09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:08.282193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-468015e9-48ee-48f9-9274-fec182c94c09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:56:08.282193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:08.282193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:08.282193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:08.282193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:08.282193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:08.282193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:08.282193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:08.282193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:08.282193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:08.282193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:08.282193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:08.282193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:08.282193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:08.282193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:08.282193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:08.283105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:08.283105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:08.283105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:08.283105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:08.283105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:08.283105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:08.283105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:08.283105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:08.283105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:08.283105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:08.283105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:08.283105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:08.283105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:08.283105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:08.283105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:08.283105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:08.283883 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:08.283883 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:08.283883 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:08.283883 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:08.283883 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:08.283883 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:08.283883 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:08.283883 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:08.283883 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:08.283883 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:08.283883 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:56:08.283883 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:08.286858 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 144/302] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:08.287703 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468015e9-48ee-48f9-9274-fec182c94c09 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:08.296031 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca7122-4cd8-4757-8d1c-70a954201572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:08.296714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca7122-4cd8-4757-8d1c-70a954201572 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:08.297001 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca7122-4cd8-4757-8d1c-70a954201572 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:08.297280 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca7122-4cd8-4757-8d1c-70a954201572 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:08.298024 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca7122-4cd8-4757-8d1c-70a954201572 None admin] RBAC: Adding query filter params (name=member) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:08.298331 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca7122-4cd8-4757-8d1c-70a954201572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:08.300239 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca7122-4cd8-4757-8d1c-70a954201572 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:08.311451 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 159/303] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:08.312275 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca7122-4cd8-4757-8d1c-70a954201572 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:08.409553 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468015e9-48ee-48f9-9274-fec182c94c09 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:08.431383 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca7122-4cd8-4757-8d1c-70a954201572 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:08.446268 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb6bbe-6b80-4bdb-aac8-a1ad69f934a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:08.447091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb6bbe-6b80-4bdb-aac8-a1ad69f934a9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:08.447375 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb6bbe-6b80-4bdb-aac8-a1ad69f934a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:08.447651 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb6bbe-6b80-4bdb-aac8-a1ad69f934a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:08.448822 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb6bbe-6b80-4bdb-aac8-a1ad69f934a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:08.450332 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb6bbe-6b80-4bdb-aac8-a1ad69f934a9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:08.451990 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 145/304] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:08.451990 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb6bbe-6b80-4bdb-aac8-a1ad69f934a9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:08.463738 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:08.463936 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:08.476352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48de8ec-2202-4d66-a59f-67ab14b80fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:08.477026 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48de8ec-2202-4d66-a59f-67ab14b80fe7 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:08.477349 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48de8ec-2202-4d66-a59f-67ab14b80fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:08.477630 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48de8ec-2202-4d66-a59f-67ab14b80fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:08.478369 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48de8ec-2202-4d66-a59f-67ab14b80fe7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:08.478972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48de8ec-2202-4d66-a59f-67ab14b80fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:08.480342 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48de8ec-2202-4d66-a59f-67ab14b80fe7 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:08.494046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 160/305] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:08.494046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48de8ec-2202-4d66-a59f-67ab14b80fe7 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:08.569490 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb6bbe-6b80-4bdb-aac8-a1ad69f934a9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:08.601247 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48de8ec-2202-4d66-a59f-67ab14b80fe7 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:08.607329 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c4d72-ac2a-4e83-b98d-da9a71d62cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:08.608193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c4d72-ac2a-4e83-b98d-da9a71d62cac None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:08.608470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c4d72-ac2a-4e83-b98d-da9a71d62cac None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:08.608739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c4d72-ac2a-4e83-b98d-da9a71d62cac None admin] PATH_INFO: `/v3/users/eddde9cc8765489da331aea3ac6cda8b` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:08.610365 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c4d72-ac2a-4e83-b98d-da9a71d62cac None admin] RBAC: Authorizing `identity:get_user(user_id=eddde9cc8765489da331aea3ac6cda8b)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:08.612548 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c4d72-ac2a-4e83-b98d-da9a71d62cac None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:08.618833 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 146/306] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:56:08 2022] GET /identity/v3/users/eddde9cc8765489da331aea3ac6cda8b => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:08.618833 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c4d72-ac2a-4e83-b98d-da9a71d62cac None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:08.641535 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16029d88-84c5-4c91-b4ea-bf3c7e9b2a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:08.642316 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16029d88-84c5-4c91-b4ea-bf3c7e9b2a93 None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:08.643029 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16029d88-84c5-4c91-b4ea-bf3c7e9b2a93 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:08.643029 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16029d88-84c5-4c91-b4ea-bf3c7e9b2a93 None admin] PATH_INFO: `/v3/groups` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:08.643737 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16029d88-84c5-4c91-b4ea-bf3c7e9b2a93 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:08.645257 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16029d88-84c5-4c91-b4ea-bf3c7e9b2a93 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:08.661239 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 161/307] 10.222.0.25 () {60 vars in 1134 bytes} [Mon Jul 11 11:56:08 2022] POST /identity/v3/groups => generated 229 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:56:08.671795 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16029d88-84c5-4c91-b4ea-bf3c7e9b2a93 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:08.714349 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:08.737301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:08.742662 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c4d72-ac2a-4e83-b98d-da9a71d62cac None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:08.785125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14badf-fa92-49b6-8cc5-0a6e911f64d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:08.786164 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14badf-fa92-49b6-8cc5-0a6e911f64d0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:08.786518 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14badf-fa92-49b6-8cc5-0a6e911f64d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:08.786898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14badf-fa92-49b6-8cc5-0a6e911f64d0 None admin] PATH_INFO: `/v3/users/d429a72556ed4c63907dc800ec514dd2` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:08.803229 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14badf-fa92-49b6-8cc5-0a6e911f64d0 None admin] RBAC: Authorizing `identity:get_user(user_id=d429a72556ed4c63907dc800ec514dd2)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:08.803430 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16029d88-84c5-4c91-b4ea-bf3c7e9b2a93 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:08.804840 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14badf-fa92-49b6-8cc5-0a6e911f64d0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:08.806690 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 147/308] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:56:08 2022] GET /identity/v3/users/d429a72556ed4c63907dc800ec514dd2 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:08.806690 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015502e-dd37-497c-85f3-bce6fa2151e5 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:08.806690 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015502e-dd37-497c-85f3-bce6fa2151e5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:08.806690 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015502e-dd37-497c-85f3-bce6fa2151e5 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:08.815383 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 148/309] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:08.816376 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015502e-dd37-497c-85f3-bce6fa2151e5 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:08.844802 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf989df-90fe-44b3-982a-af9baa942a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:08.845671 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf989df-90fe-44b3-982a-af9baa942a1c None admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:08.845947 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf989df-90fe-44b3-982a-af9baa942a1c None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:08.846227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf989df-90fe-44b3-982a-af9baa942a1c None admin] PATH_INFO: `/v3/system/users/eddde9cc8765489da331aea3ac6cda8b/roles/a4345a1838084e3494c3e85dfb3225b4` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:08.847964 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf989df-90fe-44b3-982a-af9baa942a1c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=eddde9cc8765489da331aea3ac6cda8b, role_id=a4345a1838084e3494c3e85dfb3225b4)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:08.849340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf989df-90fe-44b3-982a-af9baa942a1c None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:08.860487 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 162/310] 10.222.0.25 () {58 vars in 1334 bytes} [Mon Jul 11 11:56:08 2022] PUT /identity/v3/system/users/eddde9cc8765489da331aea3ac6cda8b/roles/a4345a1838084e3494c3e85dfb3225b4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:56:08.861764 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292402d-ded2-422e-bd5c-1e0fce52911e None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:08.862049 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292402d-ded2-422e-bd5c-1e0fce52911e None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:08.862323 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292402d-ded2-422e-bd5c-1e0fce52911e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:08.881420 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-b292402d-ded2-422e-bd5c-1e0fce52911e None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:08.882699 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-b292402d-ded2-422e-bd5c-1e0fce52911e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:08.961611 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015502e-dd37-497c-85f3-bce6fa2151e5 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:08.977129 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 163/311] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:09.004573 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292402d-ded2-422e-bd5c-1e0fce52911e None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:09.007432 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7382e-4ab4-4ccd-9a84-86820988460c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:09.009161 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7382e-4ab4-4ccd-9a84-86820988460c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:09.009443 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7382e-4ab4-4ccd-9a84-86820988460c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:09.009721 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7382e-4ab4-4ccd-9a84-86820988460c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:09.010560 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7382e-4ab4-4ccd-9a84-86820988460c None admin] RBAC: Adding query filter params (role.id=e31991ec4dc346aca330fca5d28c258f, user.id=d429a72556ed4c63907dc800ec514dd2, scope.system=all) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:09.010895 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7382e-4ab4-4ccd-9a84-86820988460c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:09.013235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7382e-4ab4-4ccd-9a84-86820988460c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:09.016067 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:09.026159 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 149/312] 10.222.0.25 () {56 vars in 1308 bytes} [Mon Jul 11 11:56:08 2022] GET /identity/v3/role_assignments?user.id=d429a72556ed4c63907dc800ec514dd2&scope.system=all&role.id=e31991ec4dc346aca330fca5d28c258f => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:09.057057 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:09.129376 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292402d-ded2-422e-bd5c-1e0fce52911e None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:09.179562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18e304-364d-4987-acc2-ea37fa44220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:09.180647 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18e304-364d-4987-acc2-ea37fa44220f None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:09.181157 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18e304-364d-4987-acc2-ea37fa44220f None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:09.181629 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18e304-364d-4987-acc2-ea37fa44220f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:09.194631 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18e304-364d-4987-acc2-ea37fa44220f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:09.203588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-ad18e304-364d-4987-acc2-ea37fa44220f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:56:09.203588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:09.203588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:09.203588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:09.203588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:09.203588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:09.203588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:09.203588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:09.203588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:09.203588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:09.203588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:09.203588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:09.203588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:09.203588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:09.203588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:09.203588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:09.204528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:09.204528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:09.204528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:09.204528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:09.204528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:09.204528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:09.204528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:09.204528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:09.204528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:09.204528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:09.204528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:09.204528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:09.204528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:09.204528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:09.204528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:09.204528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:09.205300 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:09.205300 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:09.205300 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:09.205300 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:09.205300 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:09.205300 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:09.205300 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:09.205300 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:09.205300 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:09.205300 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:09.205300 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:56:09.205300 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:09.207727 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 164/313] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:09.213823 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7382e-4ab4-4ccd-9a84-86820988460c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:09.332332 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7382e-4ab4-4ccd-9a84-86820988460c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:09.368719 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cacae-973e-4490-9a71-0ca8501b7ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:09.369389 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cacae-973e-4490-9a71-0ca8501b7ea7 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:09.369673 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cacae-973e-4490-9a71-0ca8501b7ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:09.369951 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cacae-973e-4490-9a71-0ca8501b7ea7 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:09.370693 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cacae-973e-4490-9a71-0ca8501b7ea7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:09.371032 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cacae-973e-4490-9a71-0ca8501b7ea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:09.373101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cacae-973e-4490-9a71-0ca8501b7ea7 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:09.382360 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 150/314] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:09.387713 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18e304-364d-4987-acc2-ea37fa44220f None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:09.493009 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18e304-364d-4987-acc2-ea37fa44220f None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:09.500373 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:09.534577 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f583d5-4108-4d93-8f40-ef357979e174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:09.535602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f583d5-4108-4d93-8f40-ef357979e174 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:09.535887 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f583d5-4108-4d93-8f40-ef357979e174 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:09.536157 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f583d5-4108-4d93-8f40-ef357979e174 None admin] PATH_INFO: `/v3/users/fe6a8dacedc04489a70e589886abf4e7` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:09.537345 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f583d5-4108-4d93-8f40-ef357979e174 None admin] RBAC: Authorizing `identity:get_user(user_id=fe6a8dacedc04489a70e589886abf4e7)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:09.538807 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f583d5-4108-4d93-8f40-ef357979e174 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:09.540737 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 165/315] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:56:09 2022] GET /identity/v3/users/fe6a8dacedc04489a70e589886abf4e7 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:09.545886 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cacae-973e-4490-9a71-0ca8501b7ea7 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:09.609352 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:09.651773 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cacae-973e-4490-9a71-0ca8501b7ea7 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:09.691149 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53882b01-0e63-4aab-8399-a5b2f617b683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:09.691806 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53882b01-0e63-4aab-8399-a5b2f617b683 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:09.692091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53882b01-0e63-4aab-8399-a5b2f617b683 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:09.692370 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53882b01-0e63-4aab-8399-a5b2f617b683 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:09.763341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53882b01-0e63-4aab-8399-a5b2f617b683 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:09.764817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53882b01-0e63-4aab-8399-a5b2f617b683 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:09.835064 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:09.867170 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 151/316] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:09.872853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f583d5-4108-4d93-8f40-ef357979e174 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:09.978564 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f583d5-4108-4d93-8f40-ef357979e174 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:10.015876 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcce94-3486-443f-8243-5dcc7fb5343a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:10.016739 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcce94-3486-443f-8243-5dcc7fb5343a None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:10.017019 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcce94-3486-443f-8243-5dcc7fb5343a None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:10.017291 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcce94-3486-443f-8243-5dcc7fb5343a None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:10.018486 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcce94-3486-443f-8243-5dcc7fb5343a None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:10.019975 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcce94-3486-443f-8243-5dcc7fb5343a None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:10.021669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 166/317] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:09 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:10.029821 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53882b01-0e63-4aab-8399-a5b2f617b683 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:10.135219 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53882b01-0e63-4aab-8399-a5b2f617b683 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:10.177282 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd8558-a154-4284-9a4f-85853333c5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:10.178040 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd8558-a154-4284-9a4f-85853333c5c0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:10.178396 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd8558-a154-4284-9a4f-85853333c5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:10.178832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd8558-a154-4284-9a4f-85853333c5c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:10.179766 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd8558-a154-4284-9a4f-85853333c5c0 None admin] RBAC: Adding query filter params (role.id=e31991ec4dc346aca330fca5d28c258f, scope.project.id=048e800f61d84e729c209484f6bd0635, user.id=fe6a8dacedc04489a70e589886abf4e7) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:10.180154 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd8558-a154-4284-9a4f-85853333c5c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:10.181733 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd8558-a154-4284-9a4f-85853333c5c0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:10.189135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 152/318] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:56:10 2022] GET /identity/v3/role_assignments?user.id=fe6a8dacedc04489a70e589886abf4e7&scope.project.id=048e800f61d84e729c209484f6bd0635&role.id=e31991ec4dc346aca330fca5d28c258f => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:11.128315 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b6c55-8efc-4a73-b606-f8f263bc193c None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:11.128872 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b6c55-8efc-4a73-b606-f8f263bc193c None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:11.128872 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b6c55-8efc-4a73-b606-f8f263bc193c None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:11.130345 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 167/319] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:11.137108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80d78-c0fe-4af8-9d13-edda2df65c83 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:11.137700 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80d78-c0fe-4af8-9d13-edda2df65c83 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:11.137905 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80d78-c0fe-4af8-9d13-edda2df65c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:11.156453 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c5f80d78-c0fe-4af8-9d13-edda2df65c83 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:11.157669 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c5f80d78-c0fe-4af8-9d13-edda2df65c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:11.178792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:11.231908 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 153/320] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:11.255073 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b6c55-8efc-4a73-b606-f8f263bc193c None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:11.274774 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd0415-0390-4abf-8908-5ae35d1539a0 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:11.275070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd0415-0390-4abf-8908-5ae35d1539a0 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:11.275347 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd0415-0390-4abf-8908-5ae35d1539a0 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:11.276848 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 154/321] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:56:11.282679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95ad6b-8d73-4cfe-9e7d-5712aefd6e77 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:11.283058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95ad6b-8d73-4cfe-9e7d-5712aefd6e77 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:11.283339 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95ad6b-8d73-4cfe-9e7d-5712aefd6e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:11.295522 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:11.300650 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-fb95ad6b-8d73-4cfe-9e7d-5712aefd6e77 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:11.301859 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-fb95ad6b-8d73-4cfe-9e7d-5712aefd6e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:11.360711 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b6c55-8efc-4a73-b606-f8f263bc193c None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:11.368534 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 155/322] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:11.369595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f55c12-47b4-429e-a7c8-fe5a72e3015d None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:11.369915 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f55c12-47b4-429e-a7c8-fe5a72e3015d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:11.370153 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f55c12-47b4-429e-a7c8-fe5a72e3015d None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:11.371699 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 156/323] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:11.377114 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892176a-40d3-42bb-b37a-c060b559a1fa None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:11.377401 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892176a-40d3-42bb-b37a-c060b559a1fa None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:11.377675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892176a-40d3-42bb-b37a-c060b559a1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:11.399076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-8892176a-40d3-42bb-b37a-c060b559a1fa None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:11.400183 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8892176a-40d3-42bb-b37a-c060b559a1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:11.401739 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86ba1b-6e28-43cb-96d5-9f35ba6fb185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:11.403189 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86ba1b-6e28-43cb-96d5-9f35ba6fb185 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:11.403472 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86ba1b-6e28-43cb-96d5-9f35ba6fb185 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:11.403740 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86ba1b-6e28-43cb-96d5-9f35ba6fb185 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:11.404907 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86ba1b-6e28-43cb-96d5-9f35ba6fb185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:11.406350 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86ba1b-6e28-43cb-96d5-9f35ba6fb185 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:11.407988 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 168/324] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:11.408808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86ba1b-6e28-43cb-96d5-9f35ba6fb185 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:11.474508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 157/325] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:11.475282 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892176a-40d3-42bb-b37a-c060b559a1fa None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:11.494411 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:11.516584 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86ba1b-6e28-43cb-96d5-9f35ba6fb185 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:11.518975 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:11.551247 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a04f7e-aec2-42be-b6fb-e285f46f13c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:11.552052 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a04f7e-aec2-42be-b6fb-e285f46f13c0 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:11.552315 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a04f7e-aec2-42be-b6fb-e285f46f13c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:11.552584 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a04f7e-aec2-42be-b6fb-e285f46f13c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:11.562668 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a04f7e-aec2-42be-b6fb-e285f46f13c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:11.570266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-12a04f7e-aec2-42be-b6fb-e285f46f13c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:11.570266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:11.570266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:11.570266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:11.570266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:11.570266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:11.570266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:11.570266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:11.570266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:11.570266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:11.570266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:11.570266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:11.570266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:11.570266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:11.570266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:11.570266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:11.571259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:11.571259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:11.571259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:11.571259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:11.571259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:11.571259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:11.571259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:11.571259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:11.571259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:11.571259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:11.571259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:11.571259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:11.571259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:11.571259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:11.571259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:11.571259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:11.572076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:11.572076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:11.572076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:11.572076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:11.572076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:11.572076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:11.572076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:11.572076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:11.572076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:11.572076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:11.572076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:11.572076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:11.572076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 169/326] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:11.572753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a04f7e-aec2-42be-b6fb-e285f46f13c0 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:11.581242 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892176a-40d3-42bb-b37a-c060b559a1fa None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:11.615931 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865d013-1c1c-4cf3-b71e-c5cdfe1fe4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:11.616615 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865d013-1c1c-4cf3-b71e-c5cdfe1fe4cf None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:11.616896 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865d013-1c1c-4cf3-b71e-c5cdfe1fe4cf None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:11.617167 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865d013-1c1c-4cf3-b71e-c5cdfe1fe4cf None admin] PATH_INFO: `/v3/groups` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:11.617839 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865d013-1c1c-4cf3-b71e-c5cdfe1fe4cf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:11.619319 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865d013-1c1c-4cf3-b71e-c5cdfe1fe4cf None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:11.635273 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 158/327] 10.222.0.25 () {60 vars in 1134 bytes} [Mon Jul 11 11:56:11 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:56:11.636012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865d013-1c1c-4cf3-b71e-c5cdfe1fe4cf None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:11.687179 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a04f7e-aec2-42be-b6fb-e285f46f13c0 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:11.725813 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae51ff-9984-47ed-a57f-c319bd0a4cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:11.726621 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae51ff-9984-47ed-a57f-c319bd0a4cc4 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:11.726958 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae51ff-9984-47ed-a57f-c319bd0a4cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:11.727233 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae51ff-9984-47ed-a57f-c319bd0a4cc4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:11.730390 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:11.740808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae51ff-9984-47ed-a57f-c319bd0a4cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:11.748783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-9eae51ff-9984-47ed-a57f-c319bd0a4cc4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:56:11.748783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:11.748783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:11.748783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:11.748783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:11.748783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:11.748783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:11.748783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:11.748783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:11.748783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:11.748783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:11.748783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:11.748783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:11.748783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:11.748783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:11.748783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:11.749808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:11.749808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:11.749808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:11.749808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:11.749808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:11.749808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:11.749808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:11.749808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:11.749808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:11.749808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:11.749808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:11.749808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:11.749808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:11.749808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:11.749808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:11.749808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:11.750586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:11.750586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:11.750586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:11.750586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:11.750586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:11.750586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:11.750586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:11.750586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:11.750586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:11.750586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:11.750586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:56:11.750586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:11.750586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 170/328] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:11.757492 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae51ff-9984-47ed-a57f-c319bd0a4cc4 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:11.763262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865d013-1c1c-4cf3-b71e-c5cdfe1fe4cf None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:11.785845 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:11.800920 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0b28d-c6b4-4dd9-95f9-eb9194813c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:11.801596 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0b28d-c6b4-4dd9-95f9-eb9194813c30 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:11.801916 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0b28d-c6b4-4dd9-95f9-eb9194813c30 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:11.802222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0b28d-c6b4-4dd9-95f9-eb9194813c30 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:11.802999 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0b28d-c6b4-4dd9-95f9-eb9194813c30 None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:11.803357 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0b28d-c6b4-4dd9-95f9-eb9194813c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:11.804797 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0b28d-c6b4-4dd9-95f9-eb9194813c30 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:11.815557 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 159/329] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:11.821075 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0b28d-c6b4-4dd9-95f9-eb9194813c30 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:11.884568 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae51ff-9984-47ed-a57f-c319bd0a4cc4 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:11.935920 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edc490-79bc-4bb6-aee7-ce5464246d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:11.936594 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc490-79bc-4bb6-aee7-ce5464246d67 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:11.936876 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc490-79bc-4bb6-aee7-ce5464246d67 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:11.937150 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc490-79bc-4bb6-aee7-ce5464246d67 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:11.937943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edc490-79bc-4bb6-aee7-ce5464246d67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:11.938198 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edc490-79bc-4bb6-aee7-ce5464246d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:11.939714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edc490-79bc-4bb6-aee7-ce5464246d67 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:11.945571 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0b28d-c6b4-4dd9-95f9-eb9194813c30 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:11.950566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 171/330] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:11.956853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edc490-79bc-4bb6-aee7-ce5464246d67 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:11.986784 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5d110-9d5e-4b39-b596-0df12a12c141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:11.987664 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5d110-9d5e-4b39-b596-0df12a12c141 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:11.987945 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5d110-9d5e-4b39-b596-0df12a12c141 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:11.988224 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5d110-9d5e-4b39-b596-0df12a12c141 None admin] PATH_INFO: `/v3/users/eddde9cc8765489da331aea3ac6cda8b` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:11.989414 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5d110-9d5e-4b39-b596-0df12a12c141 None admin] RBAC: Authorizing `identity:get_user(user_id=eddde9cc8765489da331aea3ac6cda8b)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:11.990910 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5d110-9d5e-4b39-b596-0df12a12c141 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:11.992771 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 160/331] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:56:11 2022] GET /identity/v3/users/eddde9cc8765489da331aea3ac6cda8b => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:12.003483 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5d110-9d5e-4b39-b596-0df12a12c141 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:12.009401 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:12.071979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:12.089280 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edc490-79bc-4bb6-aee7-ce5464246d67 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:12.139004 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c6514-1fb9-4d76-862e-f449c83a4cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:12.141119 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c6514-1fb9-4d76-862e-f449c83a4cd7 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:12.141624 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c6514-1fb9-4d76-862e-f449c83a4cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:12.142534 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c6514-1fb9-4d76-862e-f449c83a4cd7 None admin] PATH_INFO: `/v3/users/d429a72556ed4c63907dc800ec514dd2` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:12.145176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c6514-1fb9-4d76-862e-f449c83a4cd7 None admin] RBAC: Authorizing `identity:get_user(user_id=d429a72556ed4c63907dc800ec514dd2)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:12.147625 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c6514-1fb9-4d76-862e-f449c83a4cd7 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:12.148837 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5d110-9d5e-4b39-b596-0df12a12c141 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:12.150041 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 172/332] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:56:11 2022] GET /identity/v3/users/d429a72556ed4c63907dc800ec514dd2 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:12.156070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c6514-1fb9-4d76-862e-f449c83a4cd7 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:12.202383 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167940a-8ab4-4d84-912e-8ec72f126acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:12.202994 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167940a-8ab4-4d84-912e-8ec72f126acd None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:12.203280 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167940a-8ab4-4d84-912e-8ec72f126acd None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:12.203844 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167940a-8ab4-4d84-912e-8ec72f126acd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:12.204680 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167940a-8ab4-4d84-912e-8ec72f126acd None admin] RBAC: Adding query filter params (role.id=a4345a1838084e3494c3e85dfb3225b4, user.id=eddde9cc8765489da331aea3ac6cda8b, scope.system=all) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:12.205159 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167940a-8ab4-4d84-912e-8ec72f126acd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:12.207267 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167940a-8ab4-4d84-912e-8ec72f126acd None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:12.222475 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 161/333] 10.222.0.25 () {56 vars in 1308 bytes} [Mon Jul 11 11:56:12 2022] GET /identity/v3/role_assignments?user.id=eddde9cc8765489da331aea3ac6cda8b&scope.system=all&role.id=a4345a1838084e3494c3e85dfb3225b4 => generated 510 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:12.292389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c6514-1fb9-4d76-862e-f449c83a4cd7 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:12.337653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e77e9-6c5b-47a5-82ab-e1258a58f847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:12.338561 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e77e9-6c5b-47a5-82ab-e1258a58f847 None admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:12.338882 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e77e9-6c5b-47a5-82ab-e1258a58f847 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:12.339162 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e77e9-6c5b-47a5-82ab-e1258a58f847 None admin] PATH_INFO: `/v3/system/users/d429a72556ed4c63907dc800ec514dd2/roles/e31991ec4dc346aca330fca5d28c258f` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:12.342951 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e77e9-6c5b-47a5-82ab-e1258a58f847 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d429a72556ed4c63907dc800ec514dd2, role_id=e31991ec4dc346aca330fca5d28c258f)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:12.344374 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e77e9-6c5b-47a5-82ab-e1258a58f847 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:12.362014 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 173/334] 10.222.0.25 () {58 vars in 1334 bytes} [Mon Jul 11 11:56:12 2022] PUT /identity/v3/system/users/d429a72556ed4c63907dc800ec514dd2/roles/e31991ec4dc346aca330fca5d28c258f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:56:14.187464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcb1f5-9621-4e8a-9969-3f2b24774ee4 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:14.187971 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcb1f5-9621-4e8a-9969-3f2b24774ee4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:14.188066 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcb1f5-9621-4e8a-9969-3f2b24774ee4 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:14.189644 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 162/335] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:14.196604 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8a57e-ab18-4ee7-9d2e-f5573dabf10f None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:14.197039 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8a57e-ab18-4ee7-9d2e-f5573dabf10f None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:14.197216 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8a57e-ab18-4ee7-9d2e-f5573dabf10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:14.222919 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-efd8a57e-ab18-4ee7-9d2e-f5573dabf10f None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:14.224114 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-efd8a57e-ab18-4ee7-9d2e-f5573dabf10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:14.243750 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:14.319885 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 174/336] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:14.363533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcb1f5-9621-4e8a-9969-3f2b24774ee4 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:14.453599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:14.461099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa990c-0e16-4345-87a0-bf93150557db None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:14.461385 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa990c-0e16-4345-87a0-bf93150557db None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:14.461654 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa990c-0e16-4345-87a0-bf93150557db None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:14.463370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 175/337] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:14.505555 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99ee7c-1f63-413e-a04c-aba29f89b6c8 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:14.505885 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99ee7c-1f63-413e-a04c-aba29f89b6c8 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:14.506109 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99ee7c-1f63-413e-a04c-aba29f89b6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:14.524358 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcb1f5-9621-4e8a-9969-3f2b24774ee4 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:14.539722 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-0b99ee7c-1f63-413e-a04c-aba29f89b6c8 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:14.540918 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-0b99ee7c-1f63-413e-a04c-aba29f89b6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:14.584806 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cac31-610e-437e-be15-1eab6c74a712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:14.585607 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cac31-610e-437e-be15-1eab6c74a712 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:14.585887 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cac31-610e-437e-be15-1eab6c74a712 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:14.586156 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cac31-610e-437e-be15-1eab6c74a712 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:14.611645 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cac31-610e-437e-be15-1eab6c74a712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:14.619601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-189cac31-610e-437e-be15-1eab6c74a712 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:14.619601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:14.619601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:14.619601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:14.619601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:14.619601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:14.619601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:14.619601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:14.619601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:14.619601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:14.619601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:14.619601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:14.619601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:14.619601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:14.619601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:14.619601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:14.620463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:14.620463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:14.620463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:14.620463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:14.620463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:14.620463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:14.620463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:14.620463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:14.620463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:14.620463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:14.620463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:14.620463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:14.620463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:14.620463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:14.620463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:14.620463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:14.622454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:14.622454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:14.622454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:14.622454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:14.622454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:14.622454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:14.622454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:14.622454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:14.622454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:14.622454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:14.622454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:14.622454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:14.627062 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 163/338] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:14.627961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cac31-610e-437e-be15-1eab6c74a712 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:14.716564 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 176/339] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:14.776356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99ee7c-1f63-413e-a04c-aba29f89b6c8 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:14.847687 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cac31-610e-437e-be15-1eab6c74a712 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:14.915082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:14.928344 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f905c8-90dc-4d15-a556-a976b01c889f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:14.929018 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f905c8-90dc-4d15-a556-a976b01c889f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:14.929303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f905c8-90dc-4d15-a556-a976b01c889f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:14.929580 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f905c8-90dc-4d15-a556-a976b01c889f None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:14.930425 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f905c8-90dc-4d15-a556-a976b01c889f None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:14.930747 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f905c8-90dc-4d15-a556-a976b01c889f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:14.932134 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f905c8-90dc-4d15-a556-a976b01c889f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:14.948235 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:14.956319 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 164/340] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:14.960542 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f905c8-90dc-4d15-a556-a976b01c889f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:14.999042 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99ee7c-1f63-413e-a04c-aba29f89b6c8 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:15.072597 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c0bcd-4483-48ff-a487-e0faaf813c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:15.073420 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c0bcd-4483-48ff-a487-e0faaf813c22 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:15.073701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c0bcd-4483-48ff-a487-e0faaf813c22 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:15.073975 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c0bcd-4483-48ff-a487-e0faaf813c22 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:15.100069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c0bcd-4483-48ff-a487-e0faaf813c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:15.116753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-1e7c0bcd-4483-48ff-a487-e0faaf813c22 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:56:15.116753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:15.116753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:15.116753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:15.116753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:15.116753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:15.116753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:15.116753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:15.116753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:15.116753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:15.116753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:15.116753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:15.116753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:15.116753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:15.116753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:15.116753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:15.117688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:15.117688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:15.117688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:15.117688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:15.117688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:15.117688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:15.117688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:15.117688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:15.117688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:15.117688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:15.117688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:15.117688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:15.117688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:15.117688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:15.117688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:15.117688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:15.118930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:15.118930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:15.118930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:15.118930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:15.118930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:15.118930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:15.118930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:15.118930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:15.118930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:15.118930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:15.118930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:56:15.118930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:15.118930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 177/341] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:56:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:15.127750 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c0bcd-4483-48ff-a487-e0faaf813c22 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:15.161026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f905c8-90dc-4d15-a556-a976b01c889f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:15.250069 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c0bcd-4483-48ff-a487-e0faaf813c22 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:15.263566 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cf8e1-cfa8-4ab6-b167-a4c3e6d8fa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:15.264940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cf8e1-cfa8-4ab6-b167-a4c3e6d8fa7a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:15.265427 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cf8e1-cfa8-4ab6-b167-a4c3e6d8fa7a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:15.266045 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cf8e1-cfa8-4ab6-b167-a4c3e6d8fa7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:15.295902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74188ccb-48ea-45c2-8365-5a4358c73deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:15.296584 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74188ccb-48ea-45c2-8365-5a4358c73deb None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:15.296864 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74188ccb-48ea-45c2-8365-5a4358c73deb None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:15.297196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74188ccb-48ea-45c2-8365-5a4358c73deb None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:15.297957 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74188ccb-48ea-45c2-8365-5a4358c73deb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:15.298265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74188ccb-48ea-45c2-8365-5a4358c73deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:15.299709 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74188ccb-48ea-45c2-8365-5a4358c73deb None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:15.310409 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:15.315107 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 178/342] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:15.324057 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74188ccb-48ea-45c2-8365-5a4358c73deb None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:15.350040 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:15.368171 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cf8e1-cfa8-4ab6-b167-a4c3e6d8fa7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:15.369661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cf8e1-cfa8-4ab6-b167-a4c3e6d8fa7a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:15.472534 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74188ccb-48ea-45c2-8365-5a4358c73deb None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:15.507715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 165/343] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:15.513475 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cf8e1-cfa8-4ab6-b167-a4c3e6d8fa7a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:15.532517 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32933f90-6c65-46d9-95f1-1b70612edb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:15.533181 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32933f90-6c65-46d9-95f1-1b70612edb3d None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:15.533464 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32933f90-6c65-46d9-95f1-1b70612edb3d None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:15.533740 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32933f90-6c65-46d9-95f1-1b70612edb3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:15.670068 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:15.675014 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32933f90-6c65-46d9-95f1-1b70612edb3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:15.676499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32933f90-6c65-46d9-95f1-1b70612edb3d None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:15.700816 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:15.716962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cf8e1-cfa8-4ab6-b167-a4c3e6d8fa7a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:15.789001 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fb251-2ba7-462c-b809-94352df5f942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:15.789782 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fb251-2ba7-462c-b809-94352df5f942 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:15.790061 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fb251-2ba7-462c-b809-94352df5f942 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:15.790332 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fb251-2ba7-462c-b809-94352df5f942 None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:15.792244 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fb251-2ba7-462c-b809-94352df5f942 None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:15.794270 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fb251-2ba7-462c-b809-94352df5f942 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:15.800305 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 166/344] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:15 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:15.801629 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb851a23-2b85-437e-86c7-d3e572a48262 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:15.801919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb851a23-2b85-437e-86c7-d3e572a48262 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:15.802198 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb851a23-2b85-437e-86c7-d3e572a48262 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:15.803506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 167/345] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:15.809776 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb851a23-2b85-437e-86c7-d3e572a48262 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:15.885822 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 179/346] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:15.887218 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf97f95-ad8d-40d7-af4c-de5bcedc5ead None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:15.887507 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf97f95-ad8d-40d7-af4c-de5bcedc5ead None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:15.887781 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf97f95-ad8d-40d7-af4c-de5bcedc5ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:15.922871 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-1cf97f95-ad8d-40d7-af4c-de5bcedc5ead None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:15.924082 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-1cf97f95-ad8d-40d7-af4c-de5bcedc5ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:16.021635 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb851a23-2b85-437e-86c7-d3e572a48262 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:16.049986 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 180/347] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:16.050812 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf97f95-ad8d-40d7-af4c-de5bcedc5ead None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:16.099512 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:16.100381 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22538192-bd70-4f30-aac7-9b087c13d739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:16.101848 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22538192-bd70-4f30-aac7-9b087c13d739 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:16.102846 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22538192-bd70-4f30-aac7-9b087c13d739 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:16.102846 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22538192-bd70-4f30-aac7-9b087c13d739 None admin] PATH_INFO: `/v3/groups/501c092ea97c4fb79253880a96288149` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:16.114338 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22538192-bd70-4f30-aac7-9b087c13d739 None admin] RBAC: Authorizing `identity:get_group(group_id=501c092ea97c4fb79253880a96288149)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:16.117312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22538192-bd70-4f30-aac7-9b087c13d739 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:16.119964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 168/348] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Jul 11 11:56:15 2022] GET /identity/v3/groups/501c092ea97c4fb79253880a96288149 => generated 226 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:16.121634 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412871c-31e6-4e5e-9968-8e6ba64417e4 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:16.122042 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412871c-31e6-4e5e-9968-8e6ba64417e4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:16.123073 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412871c-31e6-4e5e-9968-8e6ba64417e4 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:16.124762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 169/349] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:16.125674 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412871c-31e6-4e5e-9968-8e6ba64417e4 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:16.151131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:16.205349 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf97f95-ad8d-40d7-af4c-de5bcedc5ead None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:16.251117 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d2a57-bc17-4c06-8c4a-4936f6dcb225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:16.251999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d2a57-bc17-4c06-8c4a-4936f6dcb225 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:16.252282 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d2a57-bc17-4c06-8c4a-4936f6dcb225 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:16.252556 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d2a57-bc17-4c06-8c4a-4936f6dcb225 None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:16.254464 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d2a57-bc17-4c06-8c4a-4936f6dcb225 None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:16.256488 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d2a57-bc17-4c06-8c4a-4936f6dcb225 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:16.259242 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 181/350] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:16 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:16.260333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d2a57-bc17-4c06-8c4a-4936f6dcb225 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:16.265498 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412871c-31e6-4e5e-9968-8e6ba64417e4 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:16.313866 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72cd2c-3e15-4bfa-acee-d26c34c53619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:16.314587 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72cd2c-3e15-4bfa-acee-d26c34c53619 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:16.314987 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72cd2c-3e15-4bfa-acee-d26c34c53619 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:16.315263 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72cd2c-3e15-4bfa-acee-d26c34c53619 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:16.328156 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72cd2c-3e15-4bfa-acee-d26c34c53619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:16.337933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-5e72cd2c-3e15-4bfa-acee-d26c34c53619 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:16.337933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:16.337933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:16.337933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:16.337933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:16.337933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:16.337933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:16.337933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:16.337933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:16.337933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:16.337933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:16.337933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:16.337933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:16.337933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:16.337933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:16.337933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:16.338879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:16.338879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:16.338879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:16.338879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:16.338879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:16.338879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:16.338879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:16.338879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:16.338879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:16.338879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:16.338879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:16.338879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:16.338879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:16.338879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:16.338879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:16.338879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:16.340965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:16.340965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:16.340965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:16.340965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:16.340965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:16.340965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:16.340965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:16.340965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:16.340965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:16.340965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:16.340965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:16.340965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:16.340965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 170/351] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:16.343703 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc827e-31f6-4a6e-b7fc-8f7599e1eb56 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:16.343913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc827e-31f6-4a6e-b7fc-8f7599e1eb56 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:16.346309 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc827e-31f6-4a6e-b7fc-8f7599e1eb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:16.366795 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-e7cc827e-31f6-4a6e-b7fc-8f7599e1eb56 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:16.368198 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e7cc827e-31f6-4a6e-b7fc-8f7599e1eb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:16.390663 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:16.396285 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d2a57-bc17-4c06-8c4a-4936f6dcb225 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:16.448239 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dc8dc-a1b7-4d2f-8840-8b3d8c5a4178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:16.448977 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dc8dc-a1b7-4d2f-8840-8b3d8c5a4178 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:16.449375 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dc8dc-a1b7-4d2f-8840-8b3d8c5a4178 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:16.449650 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dc8dc-a1b7-4d2f-8840-8b3d8c5a4178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:16.450513 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dc8dc-a1b7-4d2f-8840-8b3d8c5a4178 None admin] RBAC: Adding query filter params (group.id=501c092ea97c4fb79253880a96288149, role.id=a4345a1838084e3494c3e85dfb3225b4, scope.project.id=d2bf11410fd84f91989477a0c73ba52d) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:16.451749 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dc8dc-a1b7-4d2f-8840-8b3d8c5a4178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:16.453569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dc8dc-a1b7-4d2f-8840-8b3d8c5a4178 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:16.461937 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 171/352] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:16.463315 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 182/353] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Jul 11 11:56:16 2022] GET /identity/v3/role_assignments?group.id=501c092ea97c4fb79253880a96288149&scope.project.id=d2bf11410fd84f91989477a0c73ba52d&role.id=a4345a1838084e3494c3e85dfb3225b4 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:16.464318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dc8dc-a1b7-4d2f-8840-8b3d8c5a4178 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:16.466972 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc827e-31f6-4a6e-b7fc-8f7599e1eb56 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:16.487788 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:16.609838 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc827e-31f6-4a6e-b7fc-8f7599e1eb56 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:16.659917 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27bf42-756f-42c6-8c3d-73ee47c62fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:16.660805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27bf42-756f-42c6-8c3d-73ee47c62fd6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:16.661078 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27bf42-756f-42c6-8c3d-73ee47c62fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:16.661355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27bf42-756f-42c6-8c3d-73ee47c62fd6 None admin] PATH_INFO: `/v3/groups/501c092ea97c4fb79253880a96288149` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:16.662777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27bf42-756f-42c6-8c3d-73ee47c62fd6 None admin] RBAC: Authorizing `identity:get_group(group_id=501c092ea97c4fb79253880a96288149)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:16.664280 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27bf42-756f-42c6-8c3d-73ee47c62fd6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:16.666159 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 172/354] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Jul 11 11:56:16 2022] GET /identity/v3/groups/501c092ea97c4fb79253880a96288149 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:16.666272 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dc8dc-a1b7-4d2f-8840-8b3d8c5a4178 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:16.668782 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27bf42-756f-42c6-8c3d-73ee47c62fd6 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:16.712609 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db645f9-0b95-4333-88ed-c6d799881e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:16.713560 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db645f9-0b95-4333-88ed-c6d799881e52 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:16.713924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db645f9-0b95-4333-88ed-c6d799881e52 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:16.714163 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db645f9-0b95-4333-88ed-c6d799881e52 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:16.715438 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db645f9-0b95-4333-88ed-c6d799881e52 None admin] RBAC: Adding query filter params (name=member) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:16.715745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db645f9-0b95-4333-88ed-c6d799881e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:16.718114 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db645f9-0b95-4333-88ed-c6d799881e52 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:16.733619 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 183/355] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:16.735209 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2965d-1f24-48a8-8570-224aab4da96e None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:16.735498 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2965d-1f24-48a8-8570-224aab4da96e None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:16.735770 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2965d-1f24-48a8-8570-224aab4da96e None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:16.736999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 184/356] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:16.738207 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f52742-4b42-433e-9686-858665138613 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:16.738542 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f52742-4b42-433e-9686-858665138613 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:16.738842 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f52742-4b42-433e-9686-858665138613 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:16.740331 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 185/357] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:16.741051 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f52742-4b42-433e-9686-858665138613 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:16.769971 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:16.774145 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:16.800566 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27bf42-756f-42c6-8c3d-73ee47c62fd6 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:16.844923 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e61bb0-0285-46a2-ba56-02b3161b98fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:16.845783 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e61bb0-0285-46a2-ba56-02b3161b98fa None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:16.846066 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e61bb0-0285-46a2-ba56-02b3161b98fa None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:16.846341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e61bb0-0285-46a2-ba56-02b3161b98fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:16.865422 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e61bb0-0285-46a2-ba56-02b3161b98fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:16.874041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-a1e61bb0-0285-46a2-ba56-02b3161b98fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:56:16.874041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:16.874041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:16.874041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:16.874041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:16.874041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:16.874041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:16.874041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:16.874041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:16.874041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:16.874041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:16.874041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:16.874041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:16.874041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:16.874041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:16.874041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:16.875138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:16.875138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:16.875138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:16.875138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:16.875138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:16.875138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:16.875138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:16.875138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:16.875138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:16.875138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:16.875138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:16.875138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:16.875138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:16.875138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:16.875138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:16.875138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:16.876160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:16.876160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:16.876160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:16.876160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:16.876160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:16.876160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:16.876160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:16.876160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:16.876160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:16.876160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:16.876160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 11:56:16.876160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:16.876160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 173/358] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:16.876160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e61bb0-0285-46a2-ba56-02b3161b98fa None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:16.881660 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f52742-4b42-433e-9686-858665138613 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:16.927404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d01666-d924-48a5-8283-466b7bf348e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:16.928064 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d01666-d924-48a5-8283-466b7bf348e7 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:16.928732 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d01666-d924-48a5-8283-466b7bf348e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:16.929013 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d01666-d924-48a5-8283-466b7bf348e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:16.930164 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d01666-d924-48a5-8283-466b7bf348e7 None admin] RBAC: Adding query filter params (group.id=501c092ea97c4fb79253880a96288149, role.id=7b0becbc0d8a464b83a0b90da1e48a67, scope.project.id=d2bf11410fd84f91989477a0c73ba52d) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:16.930482 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d01666-d924-48a5-8283-466b7bf348e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:16.932246 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d01666-d924-48a5-8283-466b7bf348e7 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:16.942372 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 186/359] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Jul 11 11:56:16 2022] GET /identity/v3/role_assignments?group.id=501c092ea97c4fb79253880a96288149&scope.project.id=d2bf11410fd84f91989477a0c73ba52d&role.id=7b0becbc0d8a464b83a0b90da1e48a67 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:16.943948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c145a64-ecb3-4e97-b1c7-bb04c519768e None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:16.944490 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c145a64-ecb3-4e97-b1c7-bb04c519768e None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:16.944974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c145a64-ecb3-4e97-b1c7-bb04c519768e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:16.975144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-2c145a64-ecb3-4e97-b1c7-bb04c519768e None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:16.977956 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-2c145a64-ecb3-4e97-b1c7-bb04c519768e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:17.024942 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e61bb0-0285-46a2-ba56-02b3161b98fa None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:17.081512 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 187/360] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:17.081894 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b68db-ca14-4bb0-a525-c095c1bd4109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:17.082670 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b68db-ca14-4bb0-a525-c095c1bd4109 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:17.083085 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b68db-ca14-4bb0-a525-c095c1bd4109 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:17.083463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b68db-ca14-4bb0-a525-c095c1bd4109 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:17.083852 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c87cb-75b9-48f4-9310-a0f292dc5e21 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:17.084396 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c87cb-75b9-48f4-9310-a0f292dc5e21 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:17.085734 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c87cb-75b9-48f4-9310-a0f292dc5e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:17.087756 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:17.109573 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-172c87cb-75b9-48f4-9310-a0f292dc5e21 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:17.111084 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-172c87cb-75b9-48f4-9310-a0f292dc5e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:17.127651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:17.192908 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b68db-ca14-4bb0-a525-c095c1bd4109 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:17.195179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b68db-ca14-4bb0-a525-c095c1bd4109 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:17.213558 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 188/361] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:17.213558 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c87cb-75b9-48f4-9310-a0f292dc5e21 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:17.347559 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 174/362] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:17.349137 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b68db-ca14-4bb0-a525-c095c1bd4109 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:17.367613 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c87cb-75b9-48f4-9310-a0f292dc5e21 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:17.400399 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:17.419918 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2c83a-a1c6-49cf-ac44-ec9e1f14b9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:17.421170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2c83a-a1c6-49cf-ac44-ec9e1f14b9ba None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:17.421670 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2c83a-a1c6-49cf-ac44-ec9e1f14b9ba None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:17.422286 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2c83a-a1c6-49cf-ac44-ec9e1f14b9ba None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:17.423665 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2c83a-a1c6-49cf-ac44-ec9e1f14b9ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:17.424412 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2c83a-a1c6-49cf-ac44-ec9e1f14b9ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:17.426147 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2c83a-a1c6-49cf-ac44-ec9e1f14b9ba None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:17.437663 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 189/363] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:17.439395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2c83a-a1c6-49cf-ac44-ec9e1f14b9ba None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:17.459589 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:17.497275 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b68db-ca14-4bb0-a525-c095c1bd4109 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:17.549108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190f488-04ca-4540-92b1-f8c1175fb519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:17.551201 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190f488-04ca-4540-92b1-f8c1175fb519 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:17.551656 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190f488-04ca-4540-92b1-f8c1175fb519 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:17.552092 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190f488-04ca-4540-92b1-f8c1175fb519 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:17.575849 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190f488-04ca-4540-92b1-f8c1175fb519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:17.585250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-b190f488-04ca-4540-92b1-f8c1175fb519 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:56:17.585250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:17.585250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:17.585250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:17.585250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:17.585250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:17.585250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:17.585250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:17.585250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:17.585250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:17.585250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:17.585250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:17.585250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:17.585250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:17.585250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:17.585250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:17.586335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:17.586335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:17.586335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:17.586335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:17.586335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:17.586335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:17.586335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:17.586335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:17.586335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:17.586335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:17.586335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:17.586335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:17.586335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:17.586335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:17.586335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:17.586335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:17.587357 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:17.587357 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:17.587357 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:17.587357 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:17.587357 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:17.587357 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:17.587357 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:17.587357 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:17.587357 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:17.587357 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:17.587357 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:56:17.587357 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:17.590989 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 175/364] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:56:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:17.592031 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190f488-04ca-4540-92b1-f8c1175fb519 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:17.600252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2c83a-a1c6-49cf-ac44-ec9e1f14b9ba None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:17.648989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27af3b8-fc5f-4669-b0b2-b7e97d0ca6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:17.650223 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27af3b8-fc5f-4669-b0b2-b7e97d0ca6fc None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:17.650807 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27af3b8-fc5f-4669-b0b2-b7e97d0ca6fc None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:17.651522 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27af3b8-fc5f-4669-b0b2-b7e97d0ca6fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:17.666366 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27af3b8-fc5f-4669-b0b2-b7e97d0ca6fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:17.676904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-c27af3b8-fc5f-4669-b0b2-b7e97d0ca6fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:56:17.676904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:17.676904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:17.676904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:17.676904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:17.676904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:17.676904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:17.676904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:17.676904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:17.676904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:17.676904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:17.676904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:17.676904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:17.676904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:17.676904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:17.676904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:17.677800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:17.677800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:17.677800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:17.677800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:17.677800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:17.677800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:17.677800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:17.677800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:17.677800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:17.677800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:17.677800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:17.677800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:17.677800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:17.677800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:17.677800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:17.677800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:17.678620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:17.678620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:17.678620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:17.678620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:17.678620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:17.678620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:17.678620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:17.678620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:17.678620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:17.678620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:17.678620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:56:17.678620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:17.682196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 190/365] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:56:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:17.683541 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27af3b8-fc5f-4669-b0b2-b7e97d0ca6fc None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:17.726023 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:17.742295 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190f488-04ca-4540-92b1-f8c1175fb519 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:17.784683 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e84cdd-305e-4760-aad1-50088731563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:17.785404 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e84cdd-305e-4760-aad1-50088731563c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:17.785689 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e84cdd-305e-4760-aad1-50088731563c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:17.785963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e84cdd-305e-4760-aad1-50088731563c None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:17.788294 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e84cdd-305e-4760-aad1-50088731563c None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:17.789799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e84cdd-305e-4760-aad1-50088731563c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:17.791785 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 176/366] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:17 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:17.792736 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e84cdd-305e-4760-aad1-50088731563c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:17.795305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:17.837908 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27af3b8-fc5f-4669-b0b2-b7e97d0ca6fc None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:17.888626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6f1ae-935f-4861-8508-c3f5003a54f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:17.891888 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6f1ae-935f-4861-8508-c3f5003a54f8 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:17.891888 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6f1ae-935f-4861-8508-c3f5003a54f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:17.891888 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6f1ae-935f-4861-8508-c3f5003a54f8 None admin] PATH_INFO: `/v3/users/d429a72556ed4c63907dc800ec514dd2` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:17.895526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6f1ae-935f-4861-8508-c3f5003a54f8 None admin] RBAC: Authorizing `identity:get_user(user_id=d429a72556ed4c63907dc800ec514dd2)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:17.897863 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6f1ae-935f-4861-8508-c3f5003a54f8 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:17.901178 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 191/367] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Jul 11 11:56:17 2022] GET /identity/v3/users/d429a72556ed4c63907dc800ec514dd2 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:17.902636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6f1ae-935f-4861-8508-c3f5003a54f8 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:17.933168 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e84cdd-305e-4760-aad1-50088731563c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:17.977964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ff519-950f-475d-85ed-d40ed8883c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:17.979281 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ff519-950f-475d-85ed-d40ed8883c82 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:17.979392 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ff519-950f-475d-85ed-d40ed8883c82 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:17.979866 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ff519-950f-475d-85ed-d40ed8883c82 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:17.981530 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ff519-950f-475d-85ed-d40ed8883c82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:17.981530 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ff519-950f-475d-85ed-d40ed8883c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:17.983023 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ff519-950f-475d-85ed-d40ed8883c82 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:17.992341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 177/368] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:17.993361 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ff519-950f-475d-85ed-d40ed8883c82 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:18.025063 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:18.034686 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6f1ae-935f-4861-8508-c3f5003a54f8 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:18.083645 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefca33-34b4-4349-967b-fc0f2657cd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:18.084734 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefca33-34b4-4349-967b-fc0f2657cd2f None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:18.085207 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefca33-34b4-4349-967b-fc0f2657cd2f None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:18.085667 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefca33-34b4-4349-967b-fc0f2657cd2f None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:18.086579 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefca33-34b4-4349-967b-fc0f2657cd2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:18.087599 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefca33-34b4-4349-967b-fc0f2657cd2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:18.090355 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefca33-34b4-4349-967b-fc0f2657cd2f None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:18.097757 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:18.103839 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 192/369] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:18.105059 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefca33-34b4-4349-967b-fc0f2657cd2f None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:18.124498 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ff519-950f-475d-85ed-d40ed8883c82 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:18.177884 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36dbc9-a147-4fc0-becd-ebb105d21b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:18.178620 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36dbc9-a147-4fc0-becd-ebb105d21b50 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:18.179020 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36dbc9-a147-4fc0-becd-ebb105d21b50 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:18.179420 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36dbc9-a147-4fc0-becd-ebb105d21b50 None admin] PATH_INFO: `/v3/groups/501c092ea97c4fb79253880a96288149` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:18.180889 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36dbc9-a147-4fc0-becd-ebb105d21b50 None admin] RBAC: Authorizing `identity:get_group(group_id=501c092ea97c4fb79253880a96288149)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:18.182626 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36dbc9-a147-4fc0-becd-ebb105d21b50 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:18.185719 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 178/370] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Jul 11 11:56:17 2022] GET /identity/v3/groups/501c092ea97c4fb79253880a96288149 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:18.186733 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36dbc9-a147-4fc0-becd-ebb105d21b50 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:18.237319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefca33-34b4-4349-967b-fc0f2657cd2f None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:18.276719 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a2caf-a5a8-4e92-b524-0dd1c15a5c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:18.278602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a2caf-a5a8-4e92-b524-0dd1c15a5c6f None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:18.279205 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a2caf-a5a8-4e92-b524-0dd1c15a5c6f None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:18.279659 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a2caf-a5a8-4e92-b524-0dd1c15a5c6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:18.281568 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a2caf-a5a8-4e92-b524-0dd1c15a5c6f None admin] RBAC: Adding query filter params (role.id=e31991ec4dc346aca330fca5d28c258f, user.id=d429a72556ed4c63907dc800ec514dd2, scope.system=all) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:18.282090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a2caf-a5a8-4e92-b524-0dd1c15a5c6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:18.283907 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a2caf-a5a8-4e92-b524-0dd1c15a5c6f None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:18.296183 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:18.299414 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 193/371] 10.222.0.25 () {56 vars in 1308 bytes} [Mon Jul 11 11:56:18 2022] GET /identity/v3/role_assignments?user.id=d429a72556ed4c63907dc800ec514dd2&scope.system=all&role.id=e31991ec4dc346aca330fca5d28c258f => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:18.300468 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a2caf-a5a8-4e92-b524-0dd1c15a5c6f None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:18.307079 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36dbc9-a147-4fc0-becd-ebb105d21b50 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:18.364102 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6484dd-4735-41e2-b80c-8c01a7b720c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:18.364858 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6484dd-4735-41e2-b80c-8c01a7b720c2 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:18.365055 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6484dd-4735-41e2-b80c-8c01a7b720c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:18.366405 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6484dd-4735-41e2-b80c-8c01a7b720c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:18.456492 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:18.462198 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6484dd-4735-41e2-b80c-8c01a7b720c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:18.464491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6484dd-4735-41e2-b80c-8c01a7b720c2 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:18.568394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a2caf-a5a8-4e92-b524-0dd1c15a5c6f None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:18.572940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:18.585627 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 179/372] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:18.586652 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6484dd-4735-41e2-b80c-8c01a7b720c2 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:18.615073 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f16e7e-d0c4-40ab-b3c7-ab9e5e4466af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:18.616180 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f16e7e-d0c4-40ab-b3c7-ab9e5e4466af None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:18.616666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f16e7e-d0c4-40ab-b3c7-ab9e5e4466af None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:18.617142 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f16e7e-d0c4-40ab-b3c7-ab9e5e4466af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:18.700403 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f16e7e-d0c4-40ab-b3c7-ab9e5e4466af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:18.700593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6484dd-4735-41e2-b80c-8c01a7b720c2 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:18.702482 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f16e7e-d0c4-40ab-b3c7-ab9e5e4466af None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:18.738480 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef75c2-d618-4d29-b339-be6a6e70d6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:18.739179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef75c2-d618-4d29-b339-be6a6e70d6f6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:18.739472 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef75c2-d618-4d29-b339-be6a6e70d6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:18.739791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef75c2-d618-4d29-b339-be6a6e70d6f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:18.740625 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef75c2-d618-4d29-b339-be6a6e70d6f6 None admin] RBAC: Adding query filter params (group.id=501c092ea97c4fb79253880a96288149, role.id=a4345a1838084e3494c3e85dfb3225b4, scope.project.id=048e800f61d84e729c209484f6bd0635) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:18.740942 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef75c2-d618-4d29-b339-be6a6e70d6f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:18.743244 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef75c2-d618-4d29-b339-be6a6e70d6f6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:18.749346 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 180/373] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Jul 11 11:56:18 2022] GET /identity/v3/role_assignments?group.id=501c092ea97c4fb79253880a96288149&scope.project.id=048e800f61d84e729c209484f6bd0635&role.id=a4345a1838084e3494c3e85dfb3225b4 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:18.749963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef75c2-d618-4d29-b339-be6a6e70d6f6 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:18.775131 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:18.825705 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 194/374] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:18.831875 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f16e7e-d0c4-40ab-b3c7-ab9e5e4466af None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:18.843120 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:18.894341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef75c2-d618-4d29-b339-be6a6e70d6f6 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:18.936498 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf1b0b-28cd-4064-8ef9-afb2e2878fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:18.937550 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf1b0b-28cd-4064-8ef9-afb2e2878fb9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:18.937732 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf1b0b-28cd-4064-8ef9-afb2e2878fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:18.937969 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf1b0b-28cd-4064-8ef9-afb2e2878fb9 None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:18.939462 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf1b0b-28cd-4064-8ef9-afb2e2878fb9 None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:18.941327 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf1b0b-28cd-4064-8ef9-afb2e2878fb9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:18.943051 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 181/375] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:18 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:18.952682 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf1b0b-28cd-4064-8ef9-afb2e2878fb9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:18.991762 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f16e7e-d0c4-40ab-b3c7-ab9e5e4466af None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:19.031716 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5464cee-a8ee-46f3-9160-9941c5becfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:19.033020 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5464cee-a8ee-46f3-9160-9941c5becfec None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:19.033500 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5464cee-a8ee-46f3-9160-9941c5becfec None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:19.033922 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5464cee-a8ee-46f3-9160-9941c5becfec None admin] PATH_INFO: `/v3/projects/33e4605bb55c438db190b2eb3cdd5cc7` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:19.035328 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5464cee-a8ee-46f3-9160-9941c5becfec None admin] RBAC: Authorizing `identity:get_project(project_id=33e4605bb55c438db190b2eb3cdd5cc7)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:19.037183 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5464cee-a8ee-46f3-9160-9941c5becfec None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:19.039398 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 195/376] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:18 2022] GET /identity/v3/projects/33e4605bb55c438db190b2eb3cdd5cc7 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:19.045284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5464cee-a8ee-46f3-9160-9941c5becfec None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:19.075718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:19.081961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf1b0b-28cd-4064-8ef9-afb2e2878fb9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:19.109992 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:19.123625 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0c770-5a97-4a8a-8f60-1d55cd0b56d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:19.124723 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0c770-5a97-4a8a-8f60-1d55cd0b56d2 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:19.125109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0c770-5a97-4a8a-8f60-1d55cd0b56d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:19.125884 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0c770-5a97-4a8a-8f60-1d55cd0b56d2 None admin] PATH_INFO: `/v3/groups/501c092ea97c4fb79253880a96288149` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:19.127305 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0c770-5a97-4a8a-8f60-1d55cd0b56d2 None admin] RBAC: Authorizing `identity:get_group(group_id=501c092ea97c4fb79253880a96288149)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:19.129047 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0c770-5a97-4a8a-8f60-1d55cd0b56d2 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:19.132474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 182/377] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Jul 11 11:56:18 2022] GET /identity/v3/groups/501c092ea97c4fb79253880a96288149 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:19.139753 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0c770-5a97-4a8a-8f60-1d55cd0b56d2 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:19.161915 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5464cee-a8ee-46f3-9160-9941c5becfec None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:19.202071 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee122f7-9e4e-4766-9969-7b437fa4cb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:19.202997 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee122f7-9e4e-4766-9969-7b437fa4cb13 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:19.203276 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee122f7-9e4e-4766-9969-7b437fa4cb13 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:19.203548 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee122f7-9e4e-4766-9969-7b437fa4cb13 None admin] PATH_INFO: `/v3/groups/f39664d5fc3245dc84caed2566377afa` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:19.210378 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee122f7-9e4e-4766-9969-7b437fa4cb13 None admin] RBAC: Authorizing `identity:get_group(group_id=f39664d5fc3245dc84caed2566377afa)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:19.212047 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee122f7-9e4e-4766-9969-7b437fa4cb13 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:19.219329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 196/378] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Jul 11 11:56:19 2022] GET /identity/v3/groups/f39664d5fc3245dc84caed2566377afa => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:19.220866 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2107c-c5ac-4fe0-85ac-70449d726a36 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:19.221154 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2107c-c5ac-4fe0-85ac-70449d726a36 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:19.221422 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2107c-c5ac-4fe0-85ac-70449d726a36 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:19.223165 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 197/379] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:19.223678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2107c-c5ac-4fe0-85ac-70449d726a36 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:19.274887 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0c770-5a97-4a8a-8f60-1d55cd0b56d2 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:19.318752 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef62881-c5d4-4247-9bb7-30709fa4c92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:19.319703 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef62881-c5d4-4247-9bb7-30709fa4c92c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:19.319987 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef62881-c5d4-4247-9bb7-30709fa4c92c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:19.320265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef62881-c5d4-4247-9bb7-30709fa4c92c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:19.321361 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef62881-c5d4-4247-9bb7-30709fa4c92c None admin] RBAC: Adding query filter params (group.id=501c092ea97c4fb79253880a96288149, role.id=7b0becbc0d8a464b83a0b90da1e48a67, scope.project.id=048e800f61d84e729c209484f6bd0635) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:19.321675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef62881-c5d4-4247-9bb7-30709fa4c92c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:19.323976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef62881-c5d4-4247-9bb7-30709fa4c92c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:19.331659 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 183/380] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Jul 11 11:56:19 2022] GET /identity/v3/role_assignments?group.id=501c092ea97c4fb79253880a96288149&scope.project.id=048e800f61d84e729c209484f6bd0635&role.id=7b0becbc0d8a464b83a0b90da1e48a67 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:19.332965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec8483-a972-4504-bc69-3095de561e87 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:19.333268 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec8483-a972-4504-bc69-3095de561e87 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:19.333537 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec8483-a972-4504-bc69-3095de561e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:19.339321 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:19.354991 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-86ec8483-a972-4504-bc69-3095de561e87 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:19.356634 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2107c-c5ac-4fe0-85ac-70449d726a36 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:19.356767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-86ec8483-a972-4504-bc69-3095de561e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:19.425718 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:19.429457 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19d718-0df5-4a4b-b818-9d8368e16217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:19.430125 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19d718-0df5-4a4b-b818-9d8368e16217 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:19.430404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19d718-0df5-4a4b-b818-9d8368e16217 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:19.430684 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19d718-0df5-4a4b-b818-9d8368e16217 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:19.431529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19d718-0df5-4a4b-b818-9d8368e16217 None admin] RBAC: Adding query filter params (group.id=f39664d5fc3245dc84caed2566377afa, role.id=11fc9dc7c3664b2b8af8eee2462707b8, scope.project.id=33e4605bb55c438db190b2eb3cdd5cc7) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:19.431837 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19d718-0df5-4a4b-b818-9d8368e16217 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:19.434070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19d718-0df5-4a4b-b818-9d8368e16217 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:19.446869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 198/381] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Jul 11 11:56:19 2022] GET /identity/v3/role_assignments?group.id=f39664d5fc3245dc84caed2566377afa&scope.project.id=33e4605bb55c438db190b2eb3cdd5cc7&role.id=11fc9dc7c3664b2b8af8eee2462707b8 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:19.459558 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 184/382] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:19.503973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19d718-0df5-4a4b-b818-9d8368e16217 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:19.636559 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19d718-0df5-4a4b-b818-9d8368e16217 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:19.682756 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8be1f3-fb62-4a58-8db9-2a0262fbe020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:19.683713 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8be1f3-fb62-4a58-8db9-2a0262fbe020 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:19.684224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8be1f3-fb62-4a58-8db9-2a0262fbe020 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:19.684521 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8be1f3-fb62-4a58-8db9-2a0262fbe020 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:19.709056 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8be1f3-fb62-4a58-8db9-2a0262fbe020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:19.720657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-1f8be1f3-fb62-4a58-8db9-2a0262fbe020 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:19.720657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:19.720657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:19.720657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:19.720657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:19.720657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:19.720657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:19.720657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:19.720657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:19.720657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:19.720657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:19.720657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:19.720657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:19.720657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:19.720657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:19.720657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:19.721695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:19.721695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:19.721695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:19.721695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:19.721695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:19.721695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:19.721695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:19.721695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:19.721695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:19.721695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:19.721695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:19.721695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:19.721695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:19.721695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:19.721695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:19.721695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:19.723639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:19.723639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:19.723639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:19.723639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:19.723639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:19.723639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:19.723639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:19.723639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:19.723639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:19.723639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:19.723639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:19.723639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:19.723639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 199/383] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:19.730170 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec8483-a972-4504-bc69-3095de561e87 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:19.887834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec8483-a972-4504-bc69-3095de561e87 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:19.937038 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966eaef-f6ba-4cb9-ae09-1ba3ffd0b74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:19.937704 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966eaef-f6ba-4cb9-ae09-1ba3ffd0b74e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:19.937989 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966eaef-f6ba-4cb9-ae09-1ba3ffd0b74e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:19.938317 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966eaef-f6ba-4cb9-ae09-1ba3ffd0b74e None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:19.939037 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966eaef-f6ba-4cb9-ae09-1ba3ffd0b74e None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:19.939348 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966eaef-f6ba-4cb9-ae09-1ba3ffd0b74e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:19.940731 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966eaef-f6ba-4cb9-ae09-1ba3ffd0b74e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:19.955255 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 185/384] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:19.960812 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8be1f3-fb62-4a58-8db9-2a0262fbe020 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:19.963011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b250fd6-94aa-487b-973c-33e34b2dca31 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:19.963299 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b250fd6-94aa-487b-973c-33e34b2dca31 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:19.963577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b250fd6-94aa-487b-973c-33e34b2dca31 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:19.966853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 186/385] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:19.977706 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846454f-f088-47fd-bc2d-0af2ec523f55 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:19.977988 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846454f-f088-47fd-bc2d-0af2ec523f55 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:19.978273 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846454f-f088-47fd-bc2d-0af2ec523f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:19.984142 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:20.007725 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-5846454f-f088-47fd-bc2d-0af2ec523f55 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:20.008927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5846454f-f088-47fd-bc2d-0af2ec523f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:20.092250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:20.116927 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8be1f3-fb62-4a58-8db9-2a0262fbe020 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:20.138176 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 187/386] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:20.167139 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846454f-f088-47fd-bc2d-0af2ec523f55 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:20.180419 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3050ab-7672-4d29-acfb-19d622559f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:20.180419 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3050ab-7672-4d29-acfb-19d622559f46 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:20.180419 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3050ab-7672-4d29-acfb-19d622559f46 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:20.180702 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3050ab-7672-4d29-acfb-19d622559f46 None admin] PATH_INFO: `/v3/groups/501c092ea97c4fb79253880a96288149` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:20.181705 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3050ab-7672-4d29-acfb-19d622559f46 None admin] RBAC: Authorizing `identity:get_group(group_id=501c092ea97c4fb79253880a96288149)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:20.187930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3050ab-7672-4d29-acfb-19d622559f46 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:20.190462 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 200/387] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Jul 11 11:56:19 2022] GET /identity/v3/groups/501c092ea97c4fb79253880a96288149 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:20.195741 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3050ab-7672-4d29-acfb-19d622559f46 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:20.313089 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:20.337499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3050ab-7672-4d29-acfb-19d622559f46 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:20.348039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846454f-f088-47fd-bc2d-0af2ec523f55 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:20.391211 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1493644-3cbc-48cf-8f38-9f2e52b072b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:20.393064 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1493644-3cbc-48cf-8f38-9f2e52b072b4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:20.393625 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1493644-3cbc-48cf-8f38-9f2e52b072b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:20.394104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1493644-3cbc-48cf-8f38-9f2e52b072b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:20.408908 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1493644-3cbc-48cf-8f38-9f2e52b072b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:20.419777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-a1493644-3cbc-48cf-8f38-9f2e52b072b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:56:20.419777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:20.419777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:20.419777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:20.419777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:20.419777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:20.419777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:20.419777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:20.419777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:20.419777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:20.419777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:20.419777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:20.419777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:20.419777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:20.419777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:20.419777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:20.420751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:20.420751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:20.420751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:20.420751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:20.420751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:20.420751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:20.420751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:20.420751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:20.420751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:20.420751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:20.420751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:20.420751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:20.420751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:20.420751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:20.420751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:20.420751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:20.421529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:20.421529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:20.421529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:20.421529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:20.421529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:20.421529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:20.421529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:20.421529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:20.421529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:20.421529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:20.421529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:56:20.421529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:20.424657 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 188/388] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:56:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:20.430337 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1493644-3cbc-48cf-8f38-9f2e52b072b4 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:20.436252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea521b9-3cbb-4210-9405-72e8c0d1f74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:20.436427 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea521b9-3cbb-4210-9405-72e8c0d1f74d None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:20.436650 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea521b9-3cbb-4210-9405-72e8c0d1f74d None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:20.436932 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea521b9-3cbb-4210-9405-72e8c0d1f74d None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:20.438240 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea521b9-3cbb-4210-9405-72e8c0d1f74d None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:20.439722 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea521b9-3cbb-4210-9405-72e8c0d1f74d None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:20.447349 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 201/389] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:20 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:20.451669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea521b9-3cbb-4210-9405-72e8c0d1f74d None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:20.486344 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:20.561336 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1493644-3cbc-48cf-8f38-9f2e52b072b4 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:20.604070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dbba6-aebb-4021-b3f4-b0eeeb223516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:20.605164 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dbba6-aebb-4021-b3f4-b0eeeb223516 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:20.605652 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dbba6-aebb-4021-b3f4-b0eeeb223516 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:20.606143 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dbba6-aebb-4021-b3f4-b0eeeb223516 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:20.607104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dbba6-aebb-4021-b3f4-b0eeeb223516 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:20.608074 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dbba6-aebb-4021-b3f4-b0eeeb223516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:20.609832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6dbba6-aebb-4021-b3f4-b0eeeb223516 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:20.620469 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 189/390] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:20.625728 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dbba6-aebb-4021-b3f4-b0eeeb223516 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:20.700706 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea521b9-3cbb-4210-9405-72e8c0d1f74d None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:20.785700 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:20.790274 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dbba6-aebb-4021-b3f4-b0eeeb223516 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:20.799993 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774f300-241d-4f44-b33c-3fd74e69fc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:20.800893 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774f300-241d-4f44-b33c-3fd74e69fc22 None admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:20.801176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774f300-241d-4f44-b33c-3fd74e69fc22 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:20.801448 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774f300-241d-4f44-b33c-3fd74e69fc22 None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d/groups/501c092ea97c4fb79253880a96288149/roles/a4345a1838084e3494c3e85dfb3225b4` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:20.805306 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774f300-241d-4f44-b33c-3fd74e69fc22 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2bf11410fd84f91989477a0c73ba52d, group_id=501c092ea97c4fb79253880a96288149, role_id=a4345a1838084e3494c3e85dfb3225b4)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:20.806820 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774f300-241d-4f44-b33c-3fd74e69fc22 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:20.834147 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cecaa-a963-4822-bd0f-0a4396571f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:20.835582 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cecaa-a963-4822-bd0f-0a4396571f81 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:20.836106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cecaa-a963-4822-bd0f-0a4396571f81 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:20.836598 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cecaa-a963-4822-bd0f-0a4396571f81 None admin] PATH_INFO: `/v3/groups/501c092ea97c4fb79253880a96288149` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:20.838083 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cecaa-a963-4822-bd0f-0a4396571f81 None admin] RBAC: Authorizing `identity:get_group(group_id=501c092ea97c4fb79253880a96288149)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:20.840457 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cecaa-a963-4822-bd0f-0a4396571f81 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:20.842970 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 190/391] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Jul 11 11:56:20 2022] GET /identity/v3/groups/501c092ea97c4fb79253880a96288149 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:20.849592 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 202/392] 10.222.0.25 () {58 vars in 1442 bytes} [Mon Jul 11 11:56:20 2022] PUT /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d/groups/501c092ea97c4fb79253880a96288149/roles/a4345a1838084e3494c3e85dfb3225b4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:56:20.850807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cecaa-a963-4822-bd0f-0a4396571f81 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:20.994047 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cecaa-a963-4822-bd0f-0a4396571f81 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:21.036198 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75691a2a-d47b-43a7-9c9a-8ccd6fdb8974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:21.037425 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691a2a-d47b-43a7-9c9a-8ccd6fdb8974 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:21.037990 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691a2a-d47b-43a7-9c9a-8ccd6fdb8974 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:21.038465 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75691a2a-d47b-43a7-9c9a-8ccd6fdb8974 None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:21.039971 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75691a2a-d47b-43a7-9c9a-8ccd6fdb8974 None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:21.041639 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75691a2a-d47b-43a7-9c9a-8ccd6fdb8974 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:21.048286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 191/393] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:20 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:21.051162 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774f300-241d-4f44-b33c-3fd74e69fc22 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:21.079128 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:21.192595 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774f300-241d-4f44-b33c-3fd74e69fc22 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:21.229024 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edee4d-9359-4797-bf24-d10bf452c361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:21.230052 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edee4d-9359-4797-bf24-d10bf452c361 None admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:21.230459 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edee4d-9359-4797-bf24-d10bf452c361 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:21.230760 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edee4d-9359-4797-bf24-d10bf452c361 None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d/groups/501c092ea97c4fb79253880a96288149/roles/7b0becbc0d8a464b83a0b90da1e48a67` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:21.233160 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edee4d-9359-4797-bf24-d10bf452c361 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2bf11410fd84f91989477a0c73ba52d, group_id=501c092ea97c4fb79253880a96288149, role_id=7b0becbc0d8a464b83a0b90da1e48a67)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:21.234630 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edee4d-9359-4797-bf24-d10bf452c361 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:21.252799 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 203/394] 10.222.0.25 () {58 vars in 1442 bytes} [Mon Jul 11 11:56:21 2022] PUT /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d/groups/501c092ea97c4fb79253880a96288149/roles/7b0becbc0d8a464b83a0b90da1e48a67 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:56:21.730168 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275616f-52c2-49ed-a002-38ab02763357 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:21.731217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275616f-52c2-49ed-a002-38ab02763357 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:21.731647 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275616f-52c2-49ed-a002-38ab02763357 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:21.733416 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 192/395] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:21.739137 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c92261-044c-40a0-af1f-f4296d366bbb None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:21.739994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c92261-044c-40a0-af1f-f4296d366bbb None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:21.740495 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c92261-044c-40a0-af1f-f4296d366bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:21.765144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-c5c92261-044c-40a0-af1f-f4296d366bbb None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:21.766357 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-c5c92261-044c-40a0-af1f-f4296d366bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:21.842238 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:21.851213 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 204/396] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:21.893494 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275616f-52c2-49ed-a002-38ab02763357 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:21.945218 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:22.032566 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275616f-52c2-49ed-a002-38ab02763357 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:22.077393 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0533a-dad9-44d9-b54b-9290828050ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:22.078201 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0533a-dad9-44d9-b54b-9290828050ae None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:22.078489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0533a-dad9-44d9-b54b-9290828050ae None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:22.078800 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0533a-dad9-44d9-b54b-9290828050ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:22.094325 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0533a-dad9-44d9-b54b-9290828050ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:22.102192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-84f0533a-dad9-44d9-b54b-9290828050ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:22.102192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:22.102192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:22.102192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:22.102192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:22.102192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:22.102192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:22.102192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:22.102192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:22.102192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:22.102192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:22.102192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:22.102192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:22.102192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:22.102192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:22.102192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:22.103131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:22.103131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:22.103131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:22.103131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:22.103131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:22.103131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:22.103131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:22.103131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:22.103131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:22.103131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:22.103131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:22.103131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:22.103131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:22.103131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:22.103131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:22.103131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:22.104301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:22.104301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:22.104301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:22.104301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:22.104301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:22.104301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:22.104301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:22.104301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:22.104301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:22.104301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:22.104301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:22.104301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:22.107522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 193/397] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:22.113577 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c92261-044c-40a0-af1f-f4296d366bbb None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:22.252308 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c92261-044c-40a0-af1f-f4296d366bbb None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:22.292162 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f73f68-2438-4dbb-ab4d-1d1f15f577a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:22.293296 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f73f68-2438-4dbb-ab4d-1d1f15f577a6 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:22.293584 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f73f68-2438-4dbb-ab4d-1d1f15f577a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:22.294021 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f73f68-2438-4dbb-ab4d-1d1f15f577a6 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:22.295022 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f73f68-2438-4dbb-ab4d-1d1f15f577a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:22.295351 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f73f68-2438-4dbb-ab4d-1d1f15f577a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:22.296737 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f73f68-2438-4dbb-ab4d-1d1f15f577a6 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:22.305228 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6836a-feca-4e8c-963c-47d8844ddcc2 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:22.305514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6836a-feca-4e8c-963c-47d8844ddcc2 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:22.305791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6836a-feca-4e8c-963c-47d8844ddcc2 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:22.307460 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 194/398] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:56:22.309352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 205/399] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:22.313230 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d44ce-5133-4c01-8422-48efd42338bb None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:22.313507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d44ce-5133-4c01-8422-48efd42338bb None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:22.313784 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d44ce-5133-4c01-8422-48efd42338bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:22.314292 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f73f68-2438-4dbb-ab4d-1d1f15f577a6 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:22.356255 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-ab1d44ce-5133-4c01-8422-48efd42338bb None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:22.357446 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ab1d44ce-5133-4c01-8422-48efd42338bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:22.387067 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:22.443050 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f73f68-2438-4dbb-ab4d-1d1f15f577a6 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:22.513271 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce656df-5684-4aae-959d-707f9c4c3a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:22.514136 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce656df-5684-4aae-959d-707f9c4c3a10 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:22.514419 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce656df-5684-4aae-959d-707f9c4c3a10 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:22.514696 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce656df-5684-4aae-959d-707f9c4c3a10 None admin] PATH_INFO: `/v3/groups/501c092ea97c4fb79253880a96288149` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:22.519267 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce656df-5684-4aae-959d-707f9c4c3a10 None admin] RBAC: Authorizing `identity:get_group(group_id=501c092ea97c4fb79253880a96288149)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:22.520726 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce656df-5684-4aae-959d-707f9c4c3a10 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:22.522353 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 206/400] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Jul 11 11:56:22 2022] GET /identity/v3/groups/501c092ea97c4fb79253880a96288149 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:22.528993 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce656df-5684-4aae-959d-707f9c4c3a10 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:22.533242 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 195/401] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:22.577611 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d44ce-5133-4c01-8422-48efd42338bb None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:22.620066 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:22.671332 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce656df-5684-4aae-959d-707f9c4c3a10 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:22.705902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03d321-c272-47f7-b3b3-cad2724e4666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:22.706812 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03d321-c272-47f7-b3b3-cad2724e4666 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:22.707102 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03d321-c272-47f7-b3b3-cad2724e4666 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:22.707376 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03d321-c272-47f7-b3b3-cad2724e4666 None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:22.707672 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d44ce-5133-4c01-8422-48efd42338bb None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:22.708746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03d321-c272-47f7-b3b3-cad2724e4666 None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:22.710249 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03d321-c272-47f7-b3b3-cad2724e4666 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:22.712400 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 207/402] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:22 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:22.713611 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217c4e4-e015-4277-b48e-d9cd812a16ec None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:22.713895 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217c4e4-e015-4277-b48e-d9cd812a16ec None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:22.714176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217c4e4-e015-4277-b48e-d9cd812a16ec None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:22.721196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 208/403] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:22.721956 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217c4e4-e015-4277-b48e-d9cd812a16ec None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:22.723266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:22.753617 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaecb9b-9a05-46a5-b8cd-19672e381b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:22.755186 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaecb9b-9a05-46a5-b8cd-19672e381b16 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:22.755734 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaecb9b-9a05-46a5-b8cd-19672e381b16 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:22.756246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaecb9b-9a05-46a5-b8cd-19672e381b16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:22.768448 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaecb9b-9a05-46a5-b8cd-19672e381b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:22.776739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-1eaecb9b-9a05-46a5-b8cd-19672e381b16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:56:22.776739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:22.776739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:22.776739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:22.776739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:22.776739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:22.776739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:22.776739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:22.776739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:22.776739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:22.776739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:22.776739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:22.776739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:22.776739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:22.776739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:22.776739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:22.778253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:22.778253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:22.778253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:22.778253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:22.778253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:22.778253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:22.778253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:22.778253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:22.778253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:22.778253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:22.778253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:22.778253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:22.778253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:22.778253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:22.778253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:22.778253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:22.779107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:22.779107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:22.779107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:22.779107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:22.779107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:22.779107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:22.779107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:22.779107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:22.779107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:22.779107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:22.779107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:56:22.779107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:22.786412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 196/404] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:56:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:22.787945 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f2433-b1c8-4cf1-a5d5-4c4624203449 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:22.788443 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f2433-b1c8-4cf1-a5d5-4c4624203449 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:22.788923 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f2433-b1c8-4cf1-a5d5-4c4624203449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:22.806795 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-2f9f2433-b1c8-4cf1-a5d5-4c4624203449 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:22.808777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-2f9f2433-b1c8-4cf1-a5d5-4c4624203449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:22.843067 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217c4e4-e015-4277-b48e-d9cd812a16ec None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:22.885723 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 197/405] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:22.887828 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f2433-b1c8-4cf1-a5d5-4c4624203449 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:22.889164 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deff9ec-20ca-40e8-ad83-2b70dde1a347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:22.890157 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deff9ec-20ca-40e8-ad83-2b70dde1a347 None admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:22.890830 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deff9ec-20ca-40e8-ad83-2b70dde1a347 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:22.891214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deff9ec-20ca-40e8-ad83-2b70dde1a347 None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635/groups/501c092ea97c4fb79253880a96288149/roles/a4345a1838084e3494c3e85dfb3225b4` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:22.894339 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deff9ec-20ca-40e8-ad83-2b70dde1a347 None admin] RBAC: Authorizing `identity:create_grant(project_id=048e800f61d84e729c209484f6bd0635, group_id=501c092ea97c4fb79253880a96288149, role_id=a4345a1838084e3494c3e85dfb3225b4)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:22.895957 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deff9ec-20ca-40e8-ad83-2b70dde1a347 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:22.909683 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:22.914660 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 209/406] 10.222.0.25 () {58 vars in 1442 bytes} [Mon Jul 11 11:56:22 2022] PUT /identity/v3/projects/048e800f61d84e729c209484f6bd0635/groups/501c092ea97c4fb79253880a96288149/roles/a4345a1838084e3494c3e85dfb3225b4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:56:22.922268 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deff9ec-20ca-40e8-ad83-2b70dde1a347 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:23.019080 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f2433-b1c8-4cf1-a5d5-4c4624203449 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:23.037287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:23.063565 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aada3d-4f28-4010-ae2d-7794d36c4d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:23.064633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aada3d-4f28-4010-ae2d-7794d36c4d1a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:23.065084 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aada3d-4f28-4010-ae2d-7794d36c4d1a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:23.065490 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aada3d-4f28-4010-ae2d-7794d36c4d1a None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:23.066914 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aada3d-4f28-4010-ae2d-7794d36c4d1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:23.067647 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aada3d-4f28-4010-ae2d-7794d36c4d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:23.069268 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aada3d-4f28-4010-ae2d-7794d36c4d1a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:23.080689 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 198/407] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:23.087127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aada3d-4f28-4010-ae2d-7794d36c4d1a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:23.113845 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deff9ec-20ca-40e8-ad83-2b70dde1a347 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:23.194897 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:23.200673 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6c374-6016-4adc-8e56-c405ca09cce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:23.203388 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6c374-6016-4adc-8e56-c405ca09cce1 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:23.203858 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6c374-6016-4adc-8e56-c405ca09cce1 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:23.205656 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6c374-6016-4adc-8e56-c405ca09cce1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:23.227047 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6c374-6016-4adc-8e56-c405ca09cce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:23.238340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-8ce6c374-6016-4adc-8e56-c405ca09cce1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:56:23.238340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:23.238340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:23.238340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:23.238340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:23.238340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:23.238340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:23.238340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:23.238340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:23.238340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:23.238340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:23.238340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:23.238340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:23.238340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:23.238340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:23.238340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:23.239466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:23.239466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:23.239466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:23.239466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:23.239466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:23.239466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:23.239466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:23.239466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:23.239466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:23.239466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:23.239466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:23.239466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:23.239466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:23.239466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:23.239466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:23.239466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:23.240418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:23.240418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:23.240418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:23.240418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:23.240418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:23.240418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:23.240418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:23.240418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:23.240418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:23.240418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:23.240418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:56:23.240418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:23.242577 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 210/408] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:56:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:23.248799 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6c374-6016-4adc-8e56-c405ca09cce1 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:23.264507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aada3d-4f28-4010-ae2d-7794d36c4d1a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:23.324882 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4d3b3-8c00-4670-b061-dbe30b6dae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:23.326605 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4d3b3-8c00-4670-b061-dbe30b6dae70 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:23.327063 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4d3b3-8c00-4670-b061-dbe30b6dae70 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:23.327504 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4d3b3-8c00-4670-b061-dbe30b6dae70 None admin] PATH_INFO: `/v3/groups/f39664d5fc3245dc84caed2566377afa` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:23.328840 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4d3b3-8c00-4670-b061-dbe30b6dae70 None admin] RBAC: Authorizing `identity:get_group(group_id=f39664d5fc3245dc84caed2566377afa)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:23.331431 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4d3b3-8c00-4670-b061-dbe30b6dae70 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:23.337405 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 199/409] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Jul 11 11:56:23 2022] GET /identity/v3/groups/f39664d5fc3245dc84caed2566377afa => generated 229 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:23.342147 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4d3b3-8c00-4670-b061-dbe30b6dae70 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:23.386528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6c374-6016-4adc-8e56-c405ca09cce1 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:23.406070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:23.452604 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a7d90-d3f3-464c-aa3b-337a57f7dede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:23.453226 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a7d90-d3f3-464c-aa3b-337a57f7dede None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:23.453579 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a7d90-d3f3-464c-aa3b-337a57f7dede None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:23.453985 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a7d90-d3f3-464c-aa3b-337a57f7dede None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:23.454885 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a7d90-d3f3-464c-aa3b-337a57f7dede None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:23.455265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a7d90-d3f3-464c-aa3b-337a57f7dede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:23.456731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a7d90-d3f3-464c-aa3b-337a57f7dede None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:23.478108 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 211/410] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:23.480203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4d3b3-8c00-4670-b061-dbe30b6dae70 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:23.483700 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a7d90-d3f3-464c-aa3b-337a57f7dede None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:23.522636 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcf168-d592-410c-b449-65f5307b168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:23.523853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcf168-d592-410c-b449-65f5307b168c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:23.524463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcf168-d592-410c-b449-65f5307b168c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:23.525042 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcf168-d592-410c-b449-65f5307b168c None admin] PATH_INFO: `/v3/projects/33e4605bb55c438db190b2eb3cdd5cc7` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:23.526664 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcf168-d592-410c-b449-65f5307b168c None admin] RBAC: Authorizing `identity:get_project(project_id=33e4605bb55c438db190b2eb3cdd5cc7)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:23.529134 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcf168-d592-410c-b449-65f5307b168c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:23.536234 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 200/411] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:23 2022] GET /identity/v3/projects/33e4605bb55c438db190b2eb3cdd5cc7 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:23.537880 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcf168-d592-410c-b449-65f5307b168c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:23.557947 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:23.664596 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcf168-d592-410c-b449-65f5307b168c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:23.701353 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a7d90-d3f3-464c-aa3b-337a57f7dede None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:23.725245 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4930f-82fc-4546-a5b5-16e1c9b16c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:23.726132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4930f-82fc-4546-a5b5-16e1c9b16c86 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:23.726438 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4930f-82fc-4546-a5b5-16e1c9b16c86 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:23.726691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4930f-82fc-4546-a5b5-16e1c9b16c86 None admin] PATH_INFO: `/v3/projects/33e4605bb55c438db190b2eb3cdd5cc7/groups/f39664d5fc3245dc84caed2566377afa/roles/11fc9dc7c3664b2b8af8eee2462707b8` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:23.730210 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4930f-82fc-4546-a5b5-16e1c9b16c86 None admin] RBAC: Authorizing `identity:create_grant(project_id=33e4605bb55c438db190b2eb3cdd5cc7, group_id=f39664d5fc3245dc84caed2566377afa, role_id=11fc9dc7c3664b2b8af8eee2462707b8)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:23.731704 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4930f-82fc-4546-a5b5-16e1c9b16c86 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:23.763778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 201/412] 10.222.0.25 () {58 vars in 1442 bytes} [Mon Jul 11 11:56:23 2022] PUT /identity/v3/projects/33e4605bb55c438db190b2eb3cdd5cc7/groups/f39664d5fc3245dc84caed2566377afa/roles/11fc9dc7c3664b2b8af8eee2462707b8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:56:23.771039 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5872fb8-7056-4058-95dc-674d7fa535fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:23.772026 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5872fb8-7056-4058-95dc-674d7fa535fe None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:23.772371 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5872fb8-7056-4058-95dc-674d7fa535fe None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:23.772648 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5872fb8-7056-4058-95dc-674d7fa535fe None admin] PATH_INFO: `/v3/groups/501c092ea97c4fb79253880a96288149` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:23.773880 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5872fb8-7056-4058-95dc-674d7fa535fe None admin] RBAC: Authorizing `identity:get_group(group_id=501c092ea97c4fb79253880a96288149)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:23.775557 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5872fb8-7056-4058-95dc-674d7fa535fe None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:23.779057 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 212/413] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Jul 11 11:56:23 2022] GET /identity/v3/groups/501c092ea97c4fb79253880a96288149 => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:23.784447 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4930f-82fc-4546-a5b5-16e1c9b16c86 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:23.818824 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80083f2-b1bb-48d8-91f0-f582091413d5 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:23.819132 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80083f2-b1bb-48d8-91f0-f582091413d5 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:23.819393 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80083f2-b1bb-48d8-91f0-f582091413d5 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:23.821218 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 213/414] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:23.827651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afad3ee-aba7-4afc-8a43-7c8b62e01614 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:23.827944 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afad3ee-aba7-4afc-8a43-7c8b62e01614 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:23.828226 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afad3ee-aba7-4afc-8a43-7c8b62e01614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:23.891568 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:23.891898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-1afad3ee-aba7-4afc-8a43-7c8b62e01614 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:23.893113 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-1afad3ee-aba7-4afc-8a43-7c8b62e01614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:23.918560 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4930f-82fc-4546-a5b5-16e1c9b16c86 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:23.961034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652048b-1cee-4de4-8538-2530a7b9c77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:23.962360 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652048b-1cee-4de4-8538-2530a7b9c77b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:23.962649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652048b-1cee-4de4-8538-2530a7b9c77b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:23.962955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652048b-1cee-4de4-8538-2530a7b9c77b None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:23.964152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652048b-1cee-4de4-8538-2530a7b9c77b None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:23.965661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652048b-1cee-4de4-8538-2530a7b9c77b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:23.968430 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 202/415] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:23 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:23.974086 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652048b-1cee-4de4-8538-2530a7b9c77b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:24.001561 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:24.041210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 214/416] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:24.090884 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afad3ee-aba7-4afc-8a43-7c8b62e01614 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:24.109276 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652048b-1cee-4de4-8538-2530a7b9c77b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:24.187448 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c063f-ead7-4f15-b137-ccfc6358852c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:24.188441 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c063f-ead7-4f15-b137-ccfc6358852c None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:24.188730 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c063f-ead7-4f15-b137-ccfc6358852c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:24.189007 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c063f-ead7-4f15-b137-ccfc6358852c None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635/groups/501c092ea97c4fb79253880a96288149/roles/7b0becbc0d8a464b83a0b90da1e48a67` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:24.196614 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c063f-ead7-4f15-b137-ccfc6358852c None admin] RBAC: Authorizing `identity:create_grant(project_id=048e800f61d84e729c209484f6bd0635, group_id=501c092ea97c4fb79253880a96288149, role_id=7b0becbc0d8a464b83a0b90da1e48a67)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:24.199558 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c063f-ead7-4f15-b137-ccfc6358852c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:24.232385 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 203/417] 10.222.0.25 () {58 vars in 1442 bytes} [Mon Jul 11 11:56:23 2022] PUT /identity/v3/projects/048e800f61d84e729c209484f6bd0635/groups/501c092ea97c4fb79253880a96288149/roles/7b0becbc0d8a464b83a0b90da1e48a67 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:56:24.272602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afad3ee-aba7-4afc-8a43-7c8b62e01614 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:24.322044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc7be4-a748-47d6-85cd-affbe51883aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:24.323194 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc7be4-a748-47d6-85cd-affbe51883aa None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:24.324180 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc7be4-a748-47d6-85cd-affbe51883aa None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:24.324601 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc7be4-a748-47d6-85cd-affbe51883aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:24.341633 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc7be4-a748-47d6-85cd-affbe51883aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:24.349801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-21fc7be4-a748-47d6-85cd-affbe51883aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:24.349801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:24.349801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:24.349801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:24.349801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:24.349801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:24.349801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:24.349801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:24.349801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:24.349801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:24.349801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:24.349801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:24.349801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:24.349801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:24.349801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:24.349801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:24.350983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:24.350983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:24.350983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:24.350983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:24.350983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:24.350983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:24.350983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:24.350983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:24.350983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:24.350983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:24.350983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:24.350983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:24.350983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:24.350983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:24.350983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:24.350983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:24.351939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:24.351939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:24.351939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:24.351939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:24.351939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:24.351939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:24.351939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:24.351939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:24.351939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:24.351939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:24.351939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:24.351939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:24.358859 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 215/418] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:24.360690 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c063f-ead7-4f15-b137-ccfc6358852c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:24.372888 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:24.415438 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147d229-b523-4d43-abb1-6f41e9c45b03 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:24.415744 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147d229-b523-4d43-abb1-6f41e9c45b03 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:24.415979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147d229-b523-4d43-abb1-6f41e9c45b03 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:24.417750 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 216/419] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:24.426351 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93606464-4433-4b8b-916f-c478414a64df None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:24.426647 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93606464-4433-4b8b-916f-c478414a64df None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:24.426857 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93606464-4433-4b8b-916f-c478414a64df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:24.454073 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-93606464-4433-4b8b-916f-c478414a64df None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:24.455915 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-93606464-4433-4b8b-916f-c478414a64df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:24.523830 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:24.548151 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c063f-ead7-4f15-b137-ccfc6358852c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:24.588648 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2cff2-4ccf-4355-91e2-9f1b385e9c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:24.589899 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2cff2-4ccf-4355-91e2-9f1b385e9c81 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:24.590196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2cff2-4ccf-4355-91e2-9f1b385e9c81 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:24.590440 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2cff2-4ccf-4355-91e2-9f1b385e9c81 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:24.591217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2cff2-4ccf-4355-91e2-9f1b385e9c81 None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:24.591527 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2cff2-4ccf-4355-91e2-9f1b385e9c81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:24.592765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 217/420] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:24.592952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2cff2-4ccf-4355-91e2-9f1b385e9c81 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:24.603768 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 204/421] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:24.612065 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93606464-4433-4b8b-916f-c478414a64df None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:24.621342 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2cff2-4ccf-4355-91e2-9f1b385e9c81 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:24.699682 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:24.780702 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2cff2-4ccf-4355-91e2-9f1b385e9c81 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:24.786530 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93606464-4433-4b8b-916f-c478414a64df None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:24.855229 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f52a22-013f-425c-949b-dc071d0e27f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:24.856224 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f52a22-013f-425c-949b-dc071d0e27f3 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:24.856509 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f52a22-013f-425c-949b-dc071d0e27f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:24.856784 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f52a22-013f-425c-949b-dc071d0e27f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:24.857869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd125970-58cd-48c9-9b4e-cf55b25e6735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:24.858575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd125970-58cd-48c9-9b4e-cf55b25e6735 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:24.858884 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd125970-58cd-48c9-9b4e-cf55b25e6735 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:24.859157 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd125970-58cd-48c9-9b4e-cf55b25e6735 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:24.887064 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f52a22-013f-425c-949b-dc071d0e27f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:24.902940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-c6f52a22-013f-425c-949b-dc071d0e27f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:56:24.902940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:24.902940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:24.902940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:24.902940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:24.902940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:24.902940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:24.902940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:24.902940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:24.902940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:24.902940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:24.902940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:24.902940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:24.902940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:24.902940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:24.902940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:24.903832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:24.903832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:24.903832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:24.903832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:24.903832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:24.903832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:24.903832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:24.903832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:24.903832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:24.903832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:24.903832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:24.903832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:24.903832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:24.903832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:24.903832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:24.903832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:24.904630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:24.904630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:24.904630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:24.904630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:24.904630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:24.904630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:24.904630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:24.904630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:24.904630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:24.904630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:24.904630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:56:24.904630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:24.904630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 205/422] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:56:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:24.922474 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:24.925085 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f52a22-013f-425c-949b-dc071d0e27f3 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:25.007199 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd125970-58cd-48c9-9b4e-cf55b25e6735 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:25.008668 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd125970-58cd-48c9-9b4e-cf55b25e6735 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:25.046543 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f52a22-013f-425c-949b-dc071d0e27f3 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:25.074536 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:25.094910 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03b07e-245e-4cea-bd84-038cd5cd7666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:25.095588 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03b07e-245e-4cea-bd84-038cd5cd7666 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:25.095864 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03b07e-245e-4cea-bd84-038cd5cd7666 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:25.096134 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03b07e-245e-4cea-bd84-038cd5cd7666 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:25.096880 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03b07e-245e-4cea-bd84-038cd5cd7666 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:25.097183 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03b07e-245e-4cea-bd84-038cd5cd7666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:25.098561 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03b07e-245e-4cea-bd84-038cd5cd7666 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:25.109105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 206/423] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:25.115853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03b07e-245e-4cea-bd84-038cd5cd7666 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:25.240078 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 218/424] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:25.247747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd125970-58cd-48c9-9b4e-cf55b25e6735 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:25.263610 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03b07e-245e-4cea-bd84-038cd5cd7666 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:25.303608 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190eaaa-cfa6-4df5-abc9-13428f4b34dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:25.304728 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190eaaa-cfa6-4df5-abc9-13428f4b34dd None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:25.306792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190eaaa-cfa6-4df5-abc9-13428f4b34dd None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:25.307294 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190eaaa-cfa6-4df5-abc9-13428f4b34dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:25.367890 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:25.382982 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190eaaa-cfa6-4df5-abc9-13428f4b34dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:25.384819 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9190eaaa-cfa6-4df5-abc9-13428f4b34dd None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:25.387656 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:25.456704 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd125970-58cd-48c9-9b4e-cf55b25e6735 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:25.494653 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 207/425] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 11:56:25.500379 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190eaaa-cfa6-4df5-abc9-13428f4b34dd None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:25.556067 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145ecbf-f110-49b2-aae5-cb1659afb13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:25.556889 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145ecbf-f110-49b2-aae5-cb1659afb13f None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:25.557173 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145ecbf-f110-49b2-aae5-cb1659afb13f None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:25.557446 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145ecbf-f110-49b2-aae5-cb1659afb13f None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:25.563202 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145ecbf-f110-49b2-aae5-cb1659afb13f None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:25.564654 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145ecbf-f110-49b2-aae5-cb1659afb13f None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:25.566665 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 219/426] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:25 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:25.571731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145ecbf-f110-49b2-aae5-cb1659afb13f None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:25.606453 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:25.626263 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190eaaa-cfa6-4df5-abc9-13428f4b34dd None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:25.663390 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d31b73-06aa-426b-812f-ee0553b82bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:25.664477 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d31b73-06aa-426b-812f-ee0553b82bec None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:25.664898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d31b73-06aa-426b-812f-ee0553b82bec None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:25.665305 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d31b73-06aa-426b-812f-ee0553b82bec None admin] PATH_INFO: `/v3/projects/d2bf11410fd84f91989477a0c73ba52d` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:25.666641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d31b73-06aa-426b-812f-ee0553b82bec None admin] RBAC: Authorizing `identity:get_project(project_id=d2bf11410fd84f91989477a0c73ba52d)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:25.668971 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d31b73-06aa-426b-812f-ee0553b82bec None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:25.671180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 208/427] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:25 2022] GET /identity/v3/projects/d2bf11410fd84f91989477a0c73ba52d => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:25.676739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d31b73-06aa-426b-812f-ee0553b82bec None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:25.740617 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145ecbf-f110-49b2-aae5-cb1659afb13f None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:25.775773 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c6d25-de87-4535-a5ab-572753a05b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:25.776630 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c6d25-de87-4535-a5ab-572753a05b1b None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:25.777623 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c6d25-de87-4535-a5ab-572753a05b1b None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:25.778116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c6d25-de87-4535-a5ab-572753a05b1b None admin] PATH_INFO: `/v3/groups/501c092ea97c4fb79253880a96288149` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:25.780293 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c6d25-de87-4535-a5ab-572753a05b1b None admin] RBAC: Authorizing `identity:get_group(group_id=501c092ea97c4fb79253880a96288149)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:25.781966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d31b73-06aa-426b-812f-ee0553b82bec None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:25.782478 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c6d25-de87-4535-a5ab-572753a05b1b None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:25.785810 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 220/428] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Jul 11 11:56:25 2022] GET /identity/v3/groups/501c092ea97c4fb79253880a96288149 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:25.787126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cb425-2466-49c6-b5ac-68cb25db2e13 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:25.787475 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cb425-2466-49c6-b5ac-68cb25db2e13 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:25.787761 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cb425-2466-49c6-b5ac-68cb25db2e13 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:25.789177 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 221/429] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:25.794404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cb425-2466-49c6-b5ac-68cb25db2e13 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:25.799043 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:25.823209 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff61ffd-3c6f-405e-bb38-34759b480d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:25.824933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff61ffd-3c6f-405e-bb38-34759b480d99 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:25.825413 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff61ffd-3c6f-405e-bb38-34759b480d99 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:25.825878 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff61ffd-3c6f-405e-bb38-34759b480d99 None admin] PATH_INFO: `/v3/groups/501c092ea97c4fb79253880a96288149` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:25.827400 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff61ffd-3c6f-405e-bb38-34759b480d99 None admin] RBAC: Authorizing `identity:get_group(group_id=501c092ea97c4fb79253880a96288149)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:25.829035 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff61ffd-3c6f-405e-bb38-34759b480d99 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:25.831111 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 209/430] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Jul 11 11:56:25 2022] GET /identity/v3/groups/501c092ea97c4fb79253880a96288149 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:25.832587 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067952c-ef1d-4744-b82f-89632780528d None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:25.833070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067952c-ef1d-4744-b82f-89632780528d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:25.833538 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067952c-ef1d-4744-b82f-89632780528d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:25.852083 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-a067952c-ef1d-4744-b82f-89632780528d None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:25.854124 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a067952c-ef1d-4744-b82f-89632780528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:25.875125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:25.917196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cb425-2466-49c6-b5ac-68cb25db2e13 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:25.933977 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 210/431] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:25.935375 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067952c-ef1d-4744-b82f-89632780528d None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:25.981566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390ce27-26dd-40ae-9618-fe6613294eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:25.982263 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390ce27-26dd-40ae-9618-fe6613294eb0 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:25.982527 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390ce27-26dd-40ae-9618-fe6613294eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:25.982833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390ce27-26dd-40ae-9618-fe6613294eb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:25.983680 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390ce27-26dd-40ae-9618-fe6613294eb0 None admin] RBAC: Adding query filter params (group.id=501c092ea97c4fb79253880a96288149, role.id=a4345a1838084e3494c3e85dfb3225b4, scope.project.id=d2bf11410fd84f91989477a0c73ba52d) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:25.984041 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390ce27-26dd-40ae-9618-fe6613294eb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:25.985504 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390ce27-26dd-40ae-9618-fe6613294eb0 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:25.997579 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 222/432] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Jul 11 11:56:25 2022] GET /identity/v3/role_assignments?group.id=501c092ea97c4fb79253880a96288149&scope.project.id=d2bf11410fd84f91989477a0c73ba52d&role.id=a4345a1838084e3494c3e85dfb3225b4 => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:25.998506 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390ce27-26dd-40ae-9618-fe6613294eb0 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:26.058190 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067952c-ef1d-4744-b82f-89632780528d None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:26.076599 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:26.102276 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fe9d8-dd89-487a-b1f5-6573289ddc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:26.103632 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fe9d8-dd89-487a-b1f5-6573289ddc0b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:26.104282 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fe9d8-dd89-487a-b1f5-6573289ddc0b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:26.104757 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fe9d8-dd89-487a-b1f5-6573289ddc0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:26.105961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fe9d8-dd89-487a-b1f5-6573289ddc0b None admin] RBAC: Adding query filter params (group.id=501c092ea97c4fb79253880a96288149, role.id=7b0becbc0d8a464b83a0b90da1e48a67, scope.project.id=d2bf11410fd84f91989477a0c73ba52d) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:26.106592 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fe9d8-dd89-487a-b1f5-6573289ddc0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:26.108317 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fe9d8-dd89-487a-b1f5-6573289ddc0b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:26.115671 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 211/433] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Jul 11 11:56:25 2022] GET /identity/v3/role_assignments?group.id=501c092ea97c4fb79253880a96288149&scope.project.id=d2bf11410fd84f91989477a0c73ba52d&role.id=7b0becbc0d8a464b83a0b90da1e48a67 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:26.116317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390ce27-26dd-40ae-9618-fe6613294eb0 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:26.194828 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3e151-d613-48a1-a905-b661666d64f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:26.196005 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3e151-d613-48a1-a905-b661666d64f3 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:26.196483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3e151-d613-48a1-a905-b661666d64f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:26.196969 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3e151-d613-48a1-a905-b661666d64f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:26.211072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3e151-d613-48a1-a905-b661666d64f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:26.219576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-edc3e151-d613-48a1-a905-b661666d64f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:26.219576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:26.219576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:26.219576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:26.219576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:26.219576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:26.219576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:26.219576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:26.219576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:26.219576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:26.219576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:26.219576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:26.219576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:26.219576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:26.219576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:26.219576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:26.220493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:26.220493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:26.220493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:26.220493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:26.220493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:26.220493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:26.220493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:26.220493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:26.220493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:26.220493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:26.220493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:26.220493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:26.220493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:26.220493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:26.220493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:26.220493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:26.221288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:26.221288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:26.221288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:26.221288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:26.221288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:26.221288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:26.221288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:26.221288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:26.221288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:26.221288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:26.221288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 11:56:26.221288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:26.223758 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 223/434] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:26.231828 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fe9d8-dd89-487a-b1f5-6573289ddc0b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:26.272014 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:26.379706 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fe9d8-dd89-487a-b1f5-6573289ddc0b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:26.421239 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8f173-5d07-47e2-b956-b3fe10da2a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:26.421930 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8f173-5d07-47e2-b956-b3fe10da2a2e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:26.422211 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8f173-5d07-47e2-b956-b3fe10da2a2e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:26.422487 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8f173-5d07-47e2-b956-b3fe10da2a2e None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:26.423272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8f173-5d07-47e2-b956-b3fe10da2a2e None admin] RBAC: Adding query filter params (name=member) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:26.423582 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8f173-5d07-47e2-b956-b3fe10da2a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:26.424991 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8f173-5d07-47e2-b956-b3fe10da2a2e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:26.438033 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 212/435] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:56:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:26.444390 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3e151-d613-48a1-a905-b661666d64f3 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:26.572763 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3e151-d613-48a1-a905-b661666d64f3 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:26.601155 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:26.611885 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8513f-aa8d-4f32-a795-1477e0dce86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:26.612539 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8513f-aa8d-4f32-a795-1477e0dce86e None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:26.612818 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8513f-aa8d-4f32-a795-1477e0dce86e None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:26.613090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8513f-aa8d-4f32-a795-1477e0dce86e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:26.619965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43478d77-80fd-42e2-a5f4-16c1eb94dd1f None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:26.621104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43478d77-80fd-42e2-a5f4-16c1eb94dd1f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:26.621598 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43478d77-80fd-42e2-a5f4-16c1eb94dd1f None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:26.623444 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 213/436] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:56:26.628839 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f870-9ae2-4efe-9d1e-d073586bcd57 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:26.629405 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f870-9ae2-4efe-9d1e-d073586bcd57 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:26.630043 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096f870-9ae2-4efe-9d1e-d073586bcd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:26.654099 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-e096f870-9ae2-4efe-9d1e-d073586bcd57 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:26.655888 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e096f870-9ae2-4efe-9d1e-d073586bcd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:26.694297 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8513f-aa8d-4f32-a795-1477e0dce86e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:26.695844 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8513f-aa8d-4f32-a795-1477e0dce86e None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:26.758986 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 214/437] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:26.782826 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096f870-9ae2-4efe-9d1e-d073586bcd57 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:26.797265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:26.820176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 224/438] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:26.827897 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8513f-aa8d-4f32-a795-1477e0dce86e None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:26.861742 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:26.922502 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096f870-9ae2-4efe-9d1e-d073586bcd57 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:26.960125 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8513f-aa8d-4f32-a795-1477e0dce86e None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:26.969407 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7f839-af09-4648-9f5b-abfafc4946d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:26.970239 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7f839-af09-4648-9f5b-abfafc4946d3 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:26.970565 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7f839-af09-4648-9f5b-abfafc4946d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:26.970891 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7f839-af09-4648-9f5b-abfafc4946d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:26.983889 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7f839-af09-4648-9f5b-abfafc4946d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:26.991621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-65e7f839-af09-4648-9f5b-abfafc4946d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:56:26.991621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:26.991621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:26.991621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:26.991621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:26.991621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:26.991621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:26.991621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:26.991621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:26.991621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:26.991621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:26.991621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:26.991621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:26.991621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:26.991621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:26.991621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:26.992489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:26.992489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:26.992489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:26.992489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:26.992489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:26.992489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:26.992489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:26.992489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:26.992489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:26.992489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:26.992489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:26.992489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:26.992489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:26.992489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:26.992489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:26.992489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:26.993450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:26.993450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:26.993450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:26.993450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:26.993450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:26.993450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:26.993450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:26.993450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:26.993450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:26.993450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:26.993450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:56:26.993450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:26.993450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 215/439] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:56:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:26.999695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7f839-af09-4648-9f5b-abfafc4946d3 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:27.003452 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389433a1-14bb-4e0f-ad30-3dba8da03b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:27.004314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389433a1-14bb-4e0f-ad30-3dba8da03b10 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:27.004596 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389433a1-14bb-4e0f-ad30-3dba8da03b10 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:27.004867 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389433a1-14bb-4e0f-ad30-3dba8da03b10 None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:27.006047 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389433a1-14bb-4e0f-ad30-3dba8da03b10 None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:27.007648 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389433a1-14bb-4e0f-ad30-3dba8da03b10 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:27.014509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 225/440] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:26 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:27.015507 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389433a1-14bb-4e0f-ad30-3dba8da03b10 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:27.078337 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:27.114754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:27.116602 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7f839-af09-4648-9f5b-abfafc4946d3 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:27.122149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389433a1-14bb-4e0f-ad30-3dba8da03b10 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:27.151432 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050aa5c-a3d8-427e-ab46-2487c35b8e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:27.152124 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050aa5c-a3d8-427e-ab46-2487c35b8e50 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:27.152408 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050aa5c-a3d8-427e-ab46-2487c35b8e50 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:27.152692 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050aa5c-a3d8-427e-ab46-2487c35b8e50 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:27.153426 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050aa5c-a3d8-427e-ab46-2487c35b8e50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:27.153734 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050aa5c-a3d8-427e-ab46-2487c35b8e50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:27.155178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050aa5c-a3d8-427e-ab46-2487c35b8e50 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:27.156504 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eebbda-5d81-4f2f-8e2f-7c0571e0d3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:27.157369 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eebbda-5d81-4f2f-8e2f-7c0571e0d3df None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:27.157630 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eebbda-5d81-4f2f-8e2f-7c0571e0d3df None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:27.157905 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eebbda-5d81-4f2f-8e2f-7c0571e0d3df None admin] PATH_INFO: `/v3/groups/501c092ea97c4fb79253880a96288149` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:27.159139 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eebbda-5d81-4f2f-8e2f-7c0571e0d3df None admin] RBAC: Authorizing `identity:get_group(group_id=501c092ea97c4fb79253880a96288149)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:27.160516 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eebbda-5d81-4f2f-8e2f-7c0571e0d3df None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:27.162283 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 226/441] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Jul 11 11:56:27 2022] GET /identity/v3/groups/501c092ea97c4fb79253880a96288149 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:27.163396 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37519b-a2a2-4c4a-a7ff-117520af61b9 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:27.163685 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37519b-a2a2-4c4a-a7ff-117520af61b9 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:27.163960 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37519b-a2a2-4c4a-a7ff-117520af61b9 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:27.167996 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 216/442] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:27.169084 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050aa5c-a3d8-427e-ab46-2487c35b8e50 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:27.169197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 227/443] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:27.170007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37519b-a2a2-4c4a-a7ff-117520af61b9 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:27.271478 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050aa5c-a3d8-427e-ab46-2487c35b8e50 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:27.272129 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37519b-a2a2-4c4a-a7ff-117520af61b9 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:27.299406 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:27.305772 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f805b-15e3-42e1-b8ed-c911ebf630ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:27.306416 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f805b-15e3-42e1-b8ed-c911ebf630ba None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:27.306738 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f805b-15e3-42e1-b8ed-c911ebf630ba None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:27.307057 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f805b-15e3-42e1-b8ed-c911ebf630ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:27.307750 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15d407-262a-40b5-8764-e33573ecbb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:27.307889 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f805b-15e3-42e1-b8ed-c911ebf630ba None admin] RBAC: Adding query filter params (group.id=501c092ea97c4fb79253880a96288149, role.id=a4345a1838084e3494c3e85dfb3225b4, scope.project.id=048e800f61d84e729c209484f6bd0635) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:27.308941 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15d407-262a-40b5-8764-e33573ecbb62 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:27.309048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f805b-15e3-42e1-b8ed-c911ebf630ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:27.309342 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15d407-262a-40b5-8764-e33573ecbb62 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:27.309624 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15d407-262a-40b5-8764-e33573ecbb62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:27.310566 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f805b-15e3-42e1-b8ed-c911ebf630ba None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:27.316759 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 217/444] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Jul 11 11:56:27 2022] GET /identity/v3/role_assignments?group.id=501c092ea97c4fb79253880a96288149&scope.project.id=048e800f61d84e729c209484f6bd0635&role.id=a4345a1838084e3494c3e85dfb3225b4 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:27.317961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d545310-322e-4a81-8d33-647479a62bc3 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:27.318249 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d545310-322e-4a81-8d33-647479a62bc3 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:27.318530 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d545310-322e-4a81-8d33-647479a62bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:27.339694 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-0d545310-322e-4a81-8d33-647479a62bc3 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:27.340946 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0d545310-322e-4a81-8d33-647479a62bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:27.347865 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:27.390104 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15d407-262a-40b5-8764-e33573ecbb62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:27.391909 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15d407-262a-40b5-8764-e33573ecbb62 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:27.422255 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 218/445] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:27.447715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d545310-322e-4a81-8d33-647479a62bc3 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:27.506195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 228/446] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:27.512291 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15d407-262a-40b5-8764-e33573ecbb62 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:27.570933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d545310-322e-4a81-8d33-647479a62bc3 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:27.590220 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:27.601829 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:27.616211 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6032d4-cf00-4269-a4a2-298053476ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:27.617404 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6032d4-cf00-4269-a4a2-298053476ea9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:27.617700 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6032d4-cf00-4269-a4a2-298053476ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:27.617977 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6032d4-cf00-4269-a4a2-298053476ea9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:27.632455 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6032d4-cf00-4269-a4a2-298053476ea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:27.637865 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15d407-262a-40b5-8764-e33573ecbb62 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:27.640641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-1c6032d4-cf00-4269-a4a2-298053476ea9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:56:27.640641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:27.640641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:27.640641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:27.640641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:27.640641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:27.640641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:27.640641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:27.640641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:27.640641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:27.640641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:27.640641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:27.640641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:27.640641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:27.640641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:27.640641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:27.641511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:27.641511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:27.641511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:27.641511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:27.641511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:27.641511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:27.641511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:27.641511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:27.641511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:27.641511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:27.641511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:27.641511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:27.641511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:27.641511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:27.641511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:27.641511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:27.642514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:27.642514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:27.642514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:27.642514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:27.642514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:27.642514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:27.642514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:27.642514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:27.642514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:27.642514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:27.642514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 11:56:27.642514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:27.642514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 219/447] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:56:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:27.648280 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6032d4-cf00-4269-a4a2-298053476ea9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:27.681830 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1417c56-585d-4b7d-839f-d1b1296fb634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:27.682700 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1417c56-585d-4b7d-839f-d1b1296fb634 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:27.683181 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1417c56-585d-4b7d-839f-d1b1296fb634 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:27.683456 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1417c56-585d-4b7d-839f-d1b1296fb634 None admin] PATH_INFO: `/v3/projects/33e4605bb55c438db190b2eb3cdd5cc7` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:27.684672 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1417c56-585d-4b7d-839f-d1b1296fb634 None admin] RBAC: Authorizing `identity:get_project(project_id=33e4605bb55c438db190b2eb3cdd5cc7)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:27.686115 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1417c56-585d-4b7d-839f-d1b1296fb634 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:27.689163 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 229/448] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:27 2022] GET /identity/v3/projects/33e4605bb55c438db190b2eb3cdd5cc7 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:27.693468 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1417c56-585d-4b7d-839f-d1b1296fb634 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:27.760813 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6032d4-cf00-4269-a4a2-298053476ea9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:27.796012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf25f52-6e42-44a5-ac1f-41652db5e237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:27.796681 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf25f52-6e42-44a5-ac1f-41652db5e237 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:27.797188 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf25f52-6e42-44a5-ac1f-41652db5e237 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:27.797611 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf25f52-6e42-44a5-ac1f-41652db5e237 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:27.798615 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf25f52-6e42-44a5-ac1f-41652db5e237 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:27.799439 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf25f52-6e42-44a5-ac1f-41652db5e237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:27.801017 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf25f52-6e42-44a5-ac1f-41652db5e237 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:27.801226 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1417c56-585d-4b7d-839f-d1b1296fb634 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:27.809636 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 220/449] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:27.815184 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf25f52-6e42-44a5-ac1f-41652db5e237 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:27.830531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:27.836914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc156108-4e2f-494d-8153-ff6fe050a942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:27.837770 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156108-4e2f-494d-8153-ff6fe050a942 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:27.838051 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156108-4e2f-494d-8153-ff6fe050a942 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:27.838325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156108-4e2f-494d-8153-ff6fe050a942 None admin] PATH_INFO: `/v3/groups/f39664d5fc3245dc84caed2566377afa` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:27.840023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc156108-4e2f-494d-8153-ff6fe050a942 None admin] RBAC: Authorizing `identity:get_group(group_id=f39664d5fc3245dc84caed2566377afa)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:27.841484 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc156108-4e2f-494d-8153-ff6fe050a942 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:27.843125 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 230/450] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Jul 11 11:56:27 2022] GET /identity/v3/groups/f39664d5fc3245dc84caed2566377afa => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:27.848814 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc156108-4e2f-494d-8153-ff6fe050a942 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:27.862397 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:27.916009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf25f52-6e42-44a5-ac1f-41652db5e237 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:27.951011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629be36-ffa3-4637-bf5d-7f6366a1ed47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:27.951661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629be36-ffa3-4637-bf5d-7f6366a1ed47 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:27.951937 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629be36-ffa3-4637-bf5d-7f6366a1ed47 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:27.952122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc156108-4e2f-494d-8153-ff6fe050a942 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:27.952216 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629be36-ffa3-4637-bf5d-7f6366a1ed47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:27.985873 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4359f2-9afd-45b7-9d1a-c71b41f1fd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:27.986515 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4359f2-9afd-45b7-9d1a-c71b41f1fd74 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:27.986828 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4359f2-9afd-45b7-9d1a-c71b41f1fd74 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:27.987112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4359f2-9afd-45b7-9d1a-c71b41f1fd74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:27.987930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4359f2-9afd-45b7-9d1a-c71b41f1fd74 None admin] RBAC: Adding query filter params (group.id=f39664d5fc3245dc84caed2566377afa, role.id=11fc9dc7c3664b2b8af8eee2462707b8, scope.project.id=33e4605bb55c438db190b2eb3cdd5cc7) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:27.988237 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4359f2-9afd-45b7-9d1a-c71b41f1fd74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:27.989656 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4359f2-9afd-45b7-9d1a-c71b41f1fd74 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:27.996228 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 231/451] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Jul 11 11:56:27 2022] GET /identity/v3/role_assignments?group.id=f39664d5fc3245dc84caed2566377afa&scope.project.id=33e4605bb55c438db190b2eb3cdd5cc7&role.id=11fc9dc7c3664b2b8af8eee2462707b8 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:28.021895 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629be36-ffa3-4637-bf5d-7f6366a1ed47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:28.023336 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629be36-ffa3-4637-bf5d-7f6366a1ed47 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:28.072760 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:28.131504 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 221/452] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 11:56:28.137851 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4359f2-9afd-45b7-9d1a-c71b41f1fd74 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:28.203680 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:28.242375 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4359f2-9afd-45b7-9d1a-c71b41f1fd74 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:28.275236 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266a109-b1fe-4e22-8cf2-18a22b19100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:28.276026 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266a109-b1fe-4e22-8cf2-18a22b19100d None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:28.276305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266a109-b1fe-4e22-8cf2-18a22b19100d None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:28.276591 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266a109-b1fe-4e22-8cf2-18a22b19100d None admin] PATH_INFO: `/v3/projects/048e800f61d84e729c209484f6bd0635` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:28.278551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266a109-b1fe-4e22-8cf2-18a22b19100d None admin] RBAC: Authorizing `identity:get_project(project_id=048e800f61d84e729c209484f6bd0635)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:28.280029 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266a109-b1fe-4e22-8cf2-18a22b19100d None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:28.281706 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 232/453] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Jul 11 11:56:28 2022] GET /identity/v3/projects/048e800f61d84e729c209484f6bd0635 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:28.287862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629be36-ffa3-4637-bf5d-7f6366a1ed47 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:28.386659 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629be36-ffa3-4637-bf5d-7f6366a1ed47 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:28.419812 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02adb64-22ad-4d41-bfd7-5a93d89e1613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:28.420676 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02adb64-22ad-4d41-bfd7-5a93d89e1613 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:28.420956 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02adb64-22ad-4d41-bfd7-5a93d89e1613 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:28.421225 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02adb64-22ad-4d41-bfd7-5a93d89e1613 None admin] PATH_INFO: `/v3/groups/501c092ea97c4fb79253880a96288149` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:28.422379 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02adb64-22ad-4d41-bfd7-5a93d89e1613 None admin] RBAC: Authorizing `identity:get_group(group_id=501c092ea97c4fb79253880a96288149)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:28.423868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02adb64-22ad-4d41-bfd7-5a93d89e1613 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:28.425460 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 222/454] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Jul 11 11:56:28 2022] GET /identity/v3/groups/501c092ea97c4fb79253880a96288149 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:28.431322 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266a109-b1fe-4e22-8cf2-18a22b19100d None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:28.529213 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266a109-b1fe-4e22-8cf2-18a22b19100d None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:28.556304 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:28.561973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba7465-0025-45bb-b657-9d441bec7df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:28.562615 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba7465-0025-45bb-b657-9d441bec7df9 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:28.562928 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba7465-0025-45bb-b657-9d441bec7df9 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:28.563205 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba7465-0025-45bb-b657-9d441bec7df9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:28.564024 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba7465-0025-45bb-b657-9d441bec7df9 None admin] RBAC: Adding query filter params (group.id=501c092ea97c4fb79253880a96288149, role.id=7b0becbc0d8a464b83a0b90da1e48a67, scope.project.id=048e800f61d84e729c209484f6bd0635) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:28.564335 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba7465-0025-45bb-b657-9d441bec7df9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:28.565765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba7465-0025-45bb-b657-9d441bec7df9 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:28.571481 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 233/455] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Jul 11 11:56:28 2022] GET /identity/v3/role_assignments?group.id=501c092ea97c4fb79253880a96288149&scope.project.id=048e800f61d84e729c209484f6bd0635&role.id=7b0becbc0d8a464b83a0b90da1e48a67 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:31.246819 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db303a5-fb6e-4827-b214-b68103712cbe None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:31.247335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db303a5-fb6e-4827-b214-b68103712cbe None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:31.247446 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db303a5-fb6e-4827-b214-b68103712cbe None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:31.248988 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 223/456] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:31.254366 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92da339-df99-484c-b3e1-f4f4a878ceb5 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:31.254801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92da339-df99-484c-b3e1-f4f4a878ceb5 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:31.254958 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92da339-df99-484c-b3e1-f4f4a878ceb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:31.271869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-a92da339-df99-484c-b3e1-f4f4a878ceb5 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:31.273040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-a92da339-df99-484c-b3e1-f4f4a878ceb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:31.342043 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 234/457] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:31.367881 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db303a5-fb6e-4827-b214-b68103712cbe None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:31.372646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bece70d-a70c-4671-a4a0-3b919e6aa781 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:31.372979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bece70d-a70c-4671-a4a0-3b919e6aa781 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:31.373219 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bece70d-a70c-4671-a4a0-3b919e6aa781 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:31.375028 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 235/458] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:56:31.380794 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df07f8-8598-4e2e-a838-2d7ef0fc4776 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:31.381114 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df07f8-8598-4e2e-a838-2d7ef0fc4776 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:31.381357 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df07f8-8598-4e2e-a838-2d7ef0fc4776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:31.387962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:31.406558 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-d1df07f8-8598-4e2e-a838-2d7ef0fc4776 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:31.408547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-d1df07f8-8598-4e2e-a838-2d7ef0fc4776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:31.493486 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 236/459] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:31.502041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db303a5-fb6e-4827-b214-b68103712cbe None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:31.520010 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df07f8-8598-4e2e-a838-2d7ef0fc4776 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:31.539514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa5cc3-7606-4fce-86a1-a7bde87a0537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:31.540316 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa5cc3-7606-4fce-86a1-a7bde87a0537 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:31.540600 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa5cc3-7606-4fce-86a1-a7bde87a0537 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:31.540874 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa5cc3-7606-4fce-86a1-a7bde87a0537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:31.552361 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa5cc3-7606-4fce-86a1-a7bde87a0537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:31.553827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa5cc3-7606-4fce-86a1-a7bde87a0537 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:31.573237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-09fa5cc3-7606-4fce-86a1-a7bde87a0537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:31.573237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:31.573237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:31.573237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:31.573237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:31.573237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:31.573237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:31.573237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:31.573237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:31.573237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:31.573237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:31.573237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:31.573237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:31.573237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:31.573237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:31.574312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:31.575381 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:31.575381 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:31.575381 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:31.575381 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:31.575381 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 224/460] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:31.576683 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe978b-44d0-4fd4-8b34-a6e8ca4a39e5 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:31.576912 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe978b-44d0-4fd4-8b34-a6e8ca4a39e5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:31.577187 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe978b-44d0-4fd4-8b34-a6e8ca4a39e5 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:31.578436 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 225/461] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:31.583105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe978b-44d0-4fd4-8b34-a6e8ca4a39e5 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:31.593601 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:31.641419 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df07f8-8598-4e2e-a838-2d7ef0fc4776 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:31.669112 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:31.684661 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec99169-51ee-44de-8e0e-1291c57d81f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:31.685782 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec99169-51ee-44de-8e0e-1291c57d81f6 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:31.686079 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec99169-51ee-44de-8e0e-1291c57d81f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:31.686614 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec99169-51ee-44de-8e0e-1291c57d81f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:31.697596 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec99169-51ee-44de-8e0e-1291c57d81f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:31.699796 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec99169-51ee-44de-8e0e-1291c57d81f6 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:31.709015 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe978b-44d0-4fd4-8b34-a6e8ca4a39e5 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:31.719421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-eec99169-51ee-44de-8e0e-1291c57d81f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:31.719421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:31.719421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:31.719421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:31.719421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:31.719421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:31.719421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:31.719421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:31.719421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:31.719421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:31.719421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:31.719421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:31.719421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:31.719421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:31.719421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:31.720287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:31.721123 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:31.721123 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:31.721123 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:31.721123 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:31.724437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 237/462] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:31.726439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a583c5c-659a-4276-bc58-d1fb9dc497c0 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:31.726744 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a583c5c-659a-4276-bc58-d1fb9dc497c0 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:31.727036 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a583c5c-659a-4276-bc58-d1fb9dc497c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:31.746026 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-8a583c5c-659a-4276-bc58-d1fb9dc497c0 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:31.748161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-8a583c5c-659a-4276-bc58-d1fb9dc497c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:31.751517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2239f2-13f6-41e8-af1c-72c60fbe12f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:31.752184 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2239f2-13f6-41e8-af1c-72c60fbe12f5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:31.752469 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2239f2-13f6-41e8-af1c-72c60fbe12f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:31.752745 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2239f2-13f6-41e8-af1c-72c60fbe12f5 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:31.753494 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2239f2-13f6-41e8-af1c-72c60fbe12f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:31.753803 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2239f2-13f6-41e8-af1c-72c60fbe12f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:31.755656 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2239f2-13f6-41e8-af1c-72c60fbe12f5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:31.773381 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 226/463] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:31.773381 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2239f2-13f6-41e8-af1c-72c60fbe12f5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:31.825821 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 238/464] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:31.829448 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a583c5c-659a-4276-bc58-d1fb9dc497c0 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:31.871329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:31.883300 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2239f2-13f6-41e8-af1c-72c60fbe12f5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:31.908925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:31.917858 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005051e9-bcdc-4857-9431-8621b12b05d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:31.918515 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005051e9-bcdc-4857-9431-8621b12b05d0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:31.918817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005051e9-bcdc-4857-9431-8621b12b05d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:31.919094 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005051e9-bcdc-4857-9431-8621b12b05d0 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:31.919802 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005051e9-bcdc-4857-9431-8621b12b05d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:31.920105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005051e9-bcdc-4857-9431-8621b12b05d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:31.921515 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005051e9-bcdc-4857-9431-8621b12b05d0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:31.930787 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a583c5c-659a-4276-bc58-d1fb9dc497c0 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:31.933238 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 227/465] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:31.934479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44e906-2fdb-4f84-8123-0c611a5936c4 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:31.934795 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44e906-2fdb-4f84-8123-0c611a5936c4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:31.935075 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44e906-2fdb-4f84-8123-0c611a5936c4 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:31.936463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 228/466] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:31.939983 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44e906-2fdb-4f84-8123-0c611a5936c4 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:31.966642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b78d3-77ba-488c-8c8f-e18597af7282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:31.967109 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b78d3-77ba-488c-8c8f-e18597af7282 None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:31.967393 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b78d3-77ba-488c-8c8f-e18597af7282 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:31.967666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b78d3-77ba-488c-8c8f-e18597af7282 None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:31.968354 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b78d3-77ba-488c-8c8f-e18597af7282 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:31.969799 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b78d3-77ba-488c-8c8f-e18597af7282 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:31.989313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 239/467] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Jul 11 11:56:31 2022] POST /identity/v3/users => generated 246 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:56:31.990102 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b78d3-77ba-488c-8c8f-e18597af7282 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:32.073235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44e906-2fdb-4f84-8123-0c611a5936c4 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:32.099972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:32.108307 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b78d3-77ba-488c-8c8f-e18597af7282 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:32.116971 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6d098-87dd-4469-8e94-c9869b394ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:32.117804 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6d098-87dd-4469-8e94-c9869b394ec6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:32.118094 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6d098-87dd-4469-8e94-c9869b394ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:32.118791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6d098-87dd-4469-8e94-c9869b394ec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:32.132215 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6d098-87dd-4469-8e94-c9869b394ec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:32.133874 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6d098-87dd-4469-8e94-c9869b394ec6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:32.145437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d7c7d-ae7e-4bf7-a50c-c47ca423d9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:32.146121 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d7c7d-ae7e-4bf7-a50c-c47ca423d9ca None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:32.146403 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d7c7d-ae7e-4bf7-a50c-c47ca423d9ca None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:32.146677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d7c7d-ae7e-4bf7-a50c-c47ca423d9ca None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:32.147411 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d7c7d-ae7e-4bf7-a50c-c47ca423d9ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:32.148997 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d7c7d-ae7e-4bf7-a50c-c47ca423d9ca None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:32.155334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-96d6d098-87dd-4469-8e94-c9869b394ec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:32.155334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:32.155334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:32.155334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:32.155334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:32.155334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:32.155334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:32.155334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:32.155334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:32.155334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:32.155334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:32.155334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:32.155334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:32.155334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:32.155334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:32.156221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:32.157060 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:32.157060 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:32.157060 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:32.157060 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:32.159540 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 229/468] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:32.165569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76634c-fd48-4018-8c09-7fa4b35dd82c None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:32.165962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76634c-fd48-4018-8c09-7fa4b35dd82c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:32.166152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76634c-fd48-4018-8c09-7fa4b35dd82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:32.181824 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 240/469] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Jul 11 11:56:31 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:56:32.181824 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d7c7d-ae7e-4bf7-a50c-c47ca423d9ca None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:32.188492 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-9e76634c-fd48-4018-8c09-7fa4b35dd82c None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:32.190958 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-9e76634c-fd48-4018-8c09-7fa4b35dd82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:32.229962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:32.285640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 230/470] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:32.313349 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76634c-fd48-4018-8c09-7fa4b35dd82c None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:32.318234 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d7c7d-ae7e-4bf7-a50c-c47ca423d9ca None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:32.371411 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140567d-fe89-4ac5-bc89-662c2a7287bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:32.371411 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140567d-fe89-4ac5-bc89-662c2a7287bd None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:32.371411 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140567d-fe89-4ac5-bc89-662c2a7287bd None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:32.371411 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140567d-fe89-4ac5-bc89-662c2a7287bd None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:32.373431 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140567d-fe89-4ac5-bc89-662c2a7287bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:32.373431 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140567d-fe89-4ac5-bc89-662c2a7287bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:32.374314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140567d-fe89-4ac5-bc89-662c2a7287bd None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:32.396466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 241/471] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:32.398161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140567d-fe89-4ac5-bc89-662c2a7287bd None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:32.412278 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:32.458215 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76634c-fd48-4018-8c09-7fa4b35dd82c None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:32.503379 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac3faf-f860-45bf-a947-6790894a3434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:32.504757 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3faf-f860-45bf-a947-6790894a3434 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:32.505504 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3faf-f860-45bf-a947-6790894a3434 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:32.505985 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3faf-f860-45bf-a947-6790894a3434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:32.521184 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140567d-fe89-4ac5-bc89-662c2a7287bd None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:32.522037 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac3faf-f860-45bf-a947-6790894a3434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:32.524737 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac3faf-f860-45bf-a947-6790894a3434 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:32.550009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-76ac3faf-f860-45bf-a947-6790894a3434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:32.550009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:32.550009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:32.550009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:32.550009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:32.550009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:32.550009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:32.550009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:32.550009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:32.550009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:32.550009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:32.550009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:32.550009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:32.550009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:32.550009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:32.550961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:32.551808 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:32.551808 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:32.551808 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:32.551808 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:32.552655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 231/472] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:32.557511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac3faf-f860-45bf-a947-6790894a3434 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:32.560432 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333807b4-aa58-46cf-910b-6df345976c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:32.561102 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333807b4-aa58-46cf-910b-6df345976c94 None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:32.561386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333807b4-aa58-46cf-910b-6df345976c94 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:32.561648 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333807b4-aa58-46cf-910b-6df345976c94 None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:32.562348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333807b4-aa58-46cf-910b-6df345976c94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:32.563829 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333807b4-aa58-46cf-910b-6df345976c94 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:32.585157 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:32.593274 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 242/473] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Jul 11 11:56:32 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:56:32.676709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac3faf-f860-45bf-a947-6790894a3434 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:32.723329 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5effb8-a77a-4550-a515-d29caf88ced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:32.724010 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5effb8-a77a-4550-a515-d29caf88ced1 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:32.724298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5effb8-a77a-4550-a515-d29caf88ced1 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:32.724580 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5effb8-a77a-4550-a515-d29caf88ced1 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:32.725320 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5effb8-a77a-4550-a515-d29caf88ced1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:32.725634 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5effb8-a77a-4550-a515-d29caf88ced1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:32.727093 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5effb8-a77a-4550-a515-d29caf88ced1 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:32.742255 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 232/474] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:32.752192 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333807b4-aa58-46cf-910b-6df345976c94 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:32.828943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:32.867656 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333807b4-aa58-46cf-910b-6df345976c94 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:32.905888 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f80470-cdd4-4641-907c-7415bc25e5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:32.906567 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f80470-cdd4-4641-907c-7415bc25e5fe None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:32.906876 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f80470-cdd4-4641-907c-7415bc25e5fe None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:32.907157 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f80470-cdd4-4641-907c-7415bc25e5fe None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:32.907857 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f80470-cdd4-4641-907c-7415bc25e5fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:32.909403 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f80470-cdd4-4641-907c-7415bc25e5fe None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:32.933345 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 243/475] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Jul 11 11:56:32 2022] POST /identity/v3/users => generated 249 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:56:34.434293 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd2de9-2c77-49c2-b4ce-5080f5ae17a5 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:34.434797 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd2de9-2c77-49c2-b4ce-5080f5ae17a5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:34.434797 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd2de9-2c77-49c2-b4ce-5080f5ae17a5 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:34.436406 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 233/476] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:34.441721 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bd332-c54e-403f-8382-7b404ac93681 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:34.442101 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bd332-c54e-403f-8382-7b404ac93681 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:34.442288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bd332-c54e-403f-8382-7b404ac93681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:34.459387 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-c64bd332-c54e-403f-8382-7b404ac93681 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:34.460579 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-c64bd332-c54e-403f-8382-7b404ac93681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:34.538894 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 244/477] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:34.564815 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd2de9-2c77-49c2-b4ce-5080f5ae17a5 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:34.643558 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a940c4-a70a-41ae-a32e-76d4400ec2dd None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:34.643876 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a940c4-a70a-41ae-a32e-76d4400ec2dd None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:34.644120 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a940c4-a70a-41ae-a32e-76d4400ec2dd None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:34.646745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 245/478] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:56:34.651011 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfbb4a-a084-4a04-9e2a-4acd3fef9876 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:34.651850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfbb4a-a084-4a04-9e2a-4acd3fef9876 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:34.652140 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfbb4a-a084-4a04-9e2a-4acd3fef9876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:34.654917 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:34.671919 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-e3cfbb4a-a084-4a04-9e2a-4acd3fef9876 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:34.674121 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-e3cfbb4a-a084-4a04-9e2a-4acd3fef9876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:34.677153 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd2de9-2c77-49c2-b4ce-5080f5ae17a5 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:34.713113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6718f-762f-4626-a397-e34d36abbcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:34.714384 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6718f-762f-4626-a397-e34d36abbcf3 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:34.714682 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6718f-762f-4626-a397-e34d36abbcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:34.714993 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6718f-762f-4626-a397-e34d36abbcf3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:34.726921 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6718f-762f-4626-a397-e34d36abbcf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:34.732260 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:34.736178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-73d6718f-762f-4626-a397-e34d36abbcf3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:34.736178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:34.736178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:34.736178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:34.736178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:34.736178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:34.736178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:34.736178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:34.736178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:34.736178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:34.736178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:34.736178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:34.736178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:34.736178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:34.736178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:34.736178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:34.737019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:34.737019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:34.737019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:34.737019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:34.737019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:34.737019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:34.737019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:34.737019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:34.737019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:34.737019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:34.737019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:34.737019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:34.737019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:34.737019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:34.737019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:34.737019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:34.737791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:34.737791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:34.737791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:34.737791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:34.737791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:34.737791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:34.737791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:34.737791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:34.737791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:34.737791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:34.737791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:34.737791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:34.737791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 234/479] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:56:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:34.743536 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6718f-762f-4626-a397-e34d36abbcf3 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:34.751442 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 246/480] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:34.776255 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfbb4a-a084-4a04-9e2a-4acd3fef9876 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:34.849972 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6718f-762f-4626-a397-e34d36abbcf3 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:34.892627 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27fce3-d512-4b53-97d6-f2296742ad6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:34.893306 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27fce3-d512-4b53-97d6-f2296742ad6d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:34.893596 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27fce3-d512-4b53-97d6-f2296742ad6d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:34.893876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27fce3-d512-4b53-97d6-f2296742ad6d None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:34.894634 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27fce3-d512-4b53-97d6-f2296742ad6d None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:34.894977 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27fce3-d512-4b53-97d6-f2296742ad6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:34.896400 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27fce3-d512-4b53-97d6-f2296742ad6d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:34.898633 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfbb4a-a084-4a04-9e2a-4acd3fef9876 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:34.910436 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 235/481] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Jul 11 11:56:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:34.911366 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27fce3-d512-4b53-97d6-f2296742ad6d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:34.914201 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:34.940073 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08d2d8-b3b7-4213-b0de-50cadb08ec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:34.941282 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08d2d8-b3b7-4213-b0de-50cadb08ec3b None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:34.941711 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08d2d8-b3b7-4213-b0de-50cadb08ec3b None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:34.942474 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08d2d8-b3b7-4213-b0de-50cadb08ec3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:34.957467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08d2d8-b3b7-4213-b0de-50cadb08ec3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:34.973971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-8b08d2d8-b3b7-4213-b0de-50cadb08ec3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:34.973971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:34.973971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:34.973971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:34.973971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:34.973971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:34.973971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:34.973971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:34.973971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:34.973971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:34.973971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:34.973971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:34.973971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:34.973971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:34.973971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:34.973971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:34.975252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:34.975252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:34.975252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:34.975252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:34.975252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:34.975252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:34.975252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:34.975252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:34.975252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:34.975252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:34.975252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:34.975252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:34.975252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:34.975252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:34.975252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:34.975252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:34.976264 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:34.976264 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:34.976264 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:34.976264 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:34.976264 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:34.976264 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:34.976264 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:34.976264 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:34.976264 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:34.976264 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:34.976264 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:34.976264 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:34.980566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 247/482] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:56:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:34.986841 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08d2d8-b3b7-4213-b0de-50cadb08ec3b None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:35.029143 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27fce3-d512-4b53-97d6-f2296742ad6d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:35.038647 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:35.067346 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0428a8c-fd94-4417-9a7f-21d61093e25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:35.068131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0428a8c-fd94-4417-9a7f-21d61093e25d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:35.068411 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0428a8c-fd94-4417-9a7f-21d61093e25d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:35.068680 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0428a8c-fd94-4417-9a7f-21d61093e25d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:35.080892 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0428a8c-fd94-4417-9a7f-21d61093e25d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:35.082365 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0428a8c-fd94-4417-9a7f-21d61093e25d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:35.102529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-c0428a8c-fd94-4417-9a7f-21d61093e25d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:35.102529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:35.102529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:35.102529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:35.102529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:35.102529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:35.102529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:35.102529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:35.102529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:35.102529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:35.102529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:35.102529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:35.102529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:35.102529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:35.102529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:35.103865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:35.105962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:35.105962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:35.105962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:35.105962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:35.106177 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08d2d8-b3b7-4213-b0de-50cadb08ec3b None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:35.107754 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 236/483] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:35.109167 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1ef43-bb6b-4f4f-87be-47c8b793e708 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:35.109635 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1ef43-bb6b-4f4f-87be-47c8b793e708 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:35.110054 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1ef43-bb6b-4f4f-87be-47c8b793e708 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:35.111572 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 237/484] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:35.115831 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1ef43-bb6b-4f4f-87be-47c8b793e708 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:35.148864 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b1dac-c9f6-41e7-934a-a2484aefed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:35.149604 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b1dac-c9f6-41e7-934a-a2484aefed1b None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:35.149813 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b1dac-c9f6-41e7-934a-a2484aefed1b None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:35.150081 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b1dac-c9f6-41e7-934a-a2484aefed1b None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:35.150870 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b1dac-c9f6-41e7-934a-a2484aefed1b None admin] RBAC: Adding query filter params (name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:35.151174 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b1dac-c9f6-41e7-934a-a2484aefed1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:35.153089 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b1dac-c9f6-41e7-934a-a2484aefed1b None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:35.168030 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 248/485] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Jul 11 11:56:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:35.169141 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e272a0b-cadd-4afc-aaa1-7579a8403ecd None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:35.169643 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e272a0b-cadd-4afc-aaa1-7579a8403ecd None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:35.169818 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e272a0b-cadd-4afc-aaa1-7579a8403ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:35.186556 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:35.189579 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-8e272a0b-cadd-4afc-aaa1-7579a8403ecd None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:35.191004 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-8e272a0b-cadd-4afc-aaa1-7579a8403ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:35.239872 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1ef43-bb6b-4f4f-87be-47c8b793e708 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:35.274738 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 249/486] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:35.274738 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e272a0b-cadd-4afc-aaa1-7579a8403ecd None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:35.286550 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb174253-06f6-4d1f-a91a-254d6a72a5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:35.287290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb174253-06f6-4d1f-a91a-254d6a72a5c6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:35.287632 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb174253-06f6-4d1f-a91a-254d6a72a5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:35.287912 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb174253-06f6-4d1f-a91a-254d6a72a5c6 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:35.288923 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb174253-06f6-4d1f-a91a-254d6a72a5c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:35.288923 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb174253-06f6-4d1f-a91a-254d6a72a5c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:35.290378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb174253-06f6-4d1f-a91a-254d6a72a5c6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:35.314417 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 238/487] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:35.314644 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:35.314814 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060bb54-f2ae-4143-8ebf-e1edf459e41b None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:35.314814 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060bb54-f2ae-4143-8ebf-e1edf459e41b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:35.314814 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060bb54-f2ae-4143-8ebf-e1edf459e41b None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:35.314814 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 239/488] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:35.314814 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060bb54-f2ae-4143-8ebf-e1edf459e41b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:35.379629 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e272a0b-cadd-4afc-aaa1-7579a8403ecd None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:35.414021 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27503617-907c-4014-b4ef-6dcb7a0f54e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:35.414836 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27503617-907c-4014-b4ef-6dcb7a0f54e2 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:35.415118 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27503617-907c-4014-b4ef-6dcb7a0f54e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:35.415392 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27503617-907c-4014-b4ef-6dcb7a0f54e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:35.415894 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060bb54-f2ae-4143-8ebf-e1edf459e41b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:35.426359 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27503617-907c-4014-b4ef-6dcb7a0f54e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:35.427857 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27503617-907c-4014-b4ef-6dcb7a0f54e2 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:35.430552 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:35.446404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-27503617-907c-4014-b4ef-6dcb7a0f54e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:35.446404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:35.446404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:35.446404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:35.446404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:35.446404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:35.446404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:35.446404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:35.446404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:35.446404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:35.446404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:35.446404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:35.446404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:35.446404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:35.446404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:35.447655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:35.448570 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:35.448570 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:35.448570 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:35.448570 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:35.448570 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 250/489] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:35.449214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27503617-907c-4014-b4ef-6dcb7a0f54e2 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:35.456266 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3738a-35d6-4868-98f4-308307c431fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:35.457056 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3738a-35d6-4868-98f4-308307c431fb None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:35.457336 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3738a-35d6-4868-98f4-308307c431fb None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:35.457609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3738a-35d6-4868-98f4-308307c431fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:35.468668 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3738a-35d6-4868-98f4-308307c431fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:35.476290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-59d3738a-35d6-4868-98f4-308307c431fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:35.476290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:35.476290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:35.476290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:35.476290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:35.476290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:35.476290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:35.476290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:35.476290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:35.476290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:35.476290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:35.476290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:35.476290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:35.476290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:35.476290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:35.476290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:35.477271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:35.477271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:35.477271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:35.477271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:35.477271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:35.477271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:35.477271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:35.477271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:35.477271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:35.477271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:35.477271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:35.477271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:35.477271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:35.477271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:35.477271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:35.477271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:35.478048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:35.478048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:35.478048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:35.478048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:35.478048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:35.478048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:35.478048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:35.478048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:35.478048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:35.478048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:35.478048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:35.478048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:35.478048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 240/490] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:56:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:35.479005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88979046-c310-4081-860c-8f058d4d5eed None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:35.480171 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88979046-c310-4081-860c-8f058d4d5eed None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:35.480171 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88979046-c310-4081-860c-8f058d4d5eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:35.495803 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-88979046-c310-4081-860c-8f058d4d5eed None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:35.496803 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-88979046-c310-4081-860c-8f058d4d5eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:35.538488 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:35.553645 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27503617-907c-4014-b4ef-6dcb7a0f54e2 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:35.566360 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 241/491] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:35.567221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88979046-c310-4081-860c-8f058d4d5eed None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:35.594054 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382994d-b597-44eb-8d97-b85ad2b19bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:35.594883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382994d-b597-44eb-8d97-b85ad2b19bc6 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:35.595166 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382994d-b597-44eb-8d97-b85ad2b19bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:35.595437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382994d-b597-44eb-8d97-b85ad2b19bc6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:35.602930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382994d-b597-44eb-8d97-b85ad2b19bc6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:35.605177 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382994d-b597-44eb-8d97-b85ad2b19bc6 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:35.620950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-c382994d-b597-44eb-8d97-b85ad2b19bc6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:56:35.620950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:35.620950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:35.620950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:35.620950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:35.620950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:35.620950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:35.620950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:35.620950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:35.620950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:35.620950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:35.620950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:35.620950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:56:35.620950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:56:35.620950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:56:35.620950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:35.621847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:35.622745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:35.622745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:35.622745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:56:35.622745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:56:35.622745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:56:35.622745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:56:35.622745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:56:35.622745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:56:35.622745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:56:35.622745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:35.622745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 251/492] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Jul 11 11:56:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:35.623323 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382994d-b597-44eb-8d97-b85ad2b19bc6 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:35.674937 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88979046-c310-4081-860c-8f058d4d5eed None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:35.677411 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:35.709527 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088213b3-2b55-4d17-8707-f1850be0649c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:35.710178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088213b3-2b55-4d17-8707-f1850be0649c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:35.710462 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088213b3-2b55-4d17-8707-f1850be0649c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:35.710764 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088213b3-2b55-4d17-8707-f1850be0649c None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:35.711511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088213b3-2b55-4d17-8707-f1850be0649c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:35.711817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088213b3-2b55-4d17-8707-f1850be0649c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:35.713219 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088213b3-2b55-4d17-8707-f1850be0649c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:35.720772 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382994d-b597-44eb-8d97-b85ad2b19bc6 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:35.724770 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 242/493] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:35.725589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088213b3-2b55-4d17-8707-f1850be0649c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:35.753774 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a641da-0474-48c6-8853-f11d3d5eecdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:35.754365 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a641da-0474-48c6-8853-f11d3d5eecdc None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:35.754647 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a641da-0474-48c6-8853-f11d3d5eecdc None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:35.754971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a641da-0474-48c6-8853-f11d3d5eecdc None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:35.755705 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a641da-0474-48c6-8853-f11d3d5eecdc None admin] RBAC: Adding query filter params (name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:35.756012 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a641da-0474-48c6-8853-f11d3d5eecdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:35.757389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a641da-0474-48c6-8853-f11d3d5eecdc None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:35.765873 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 252/494] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Jul 11 11:56:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:35.766636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a641da-0474-48c6-8853-f11d3d5eecdc None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:35.777822 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:35.825720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088213b3-2b55-4d17-8707-f1850be0649c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:35.861431 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5040871-4218-455d-b38e-df6f604d5d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:35.862216 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5040871-4218-455d-b38e-df6f604d5d1d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:35.862503 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5040871-4218-455d-b38e-df6f604d5d1d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:35.862809 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5040871-4218-455d-b38e-df6f604d5d1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:35.871988 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a641da-0474-48c6-8853-f11d3d5eecdc None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:35.873078 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5040871-4218-455d-b38e-df6f604d5d1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:35.880799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-c5040871-4218-455d-b38e-df6f604d5d1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:35.880799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:35.880799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:35.880799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:35.880799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:35.880799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:35.880799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:35.880799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:35.880799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:35.880799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:35.880799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:35.880799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:35.880799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:35.880799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:35.880799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:35.880799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:35.881695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:35.881695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:35.881695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:35.881695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:35.881695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:35.881695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:35.881695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:35.881695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:35.881695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:35.881695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:35.881695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:35.881695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:35.881695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:35.881695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:35.881695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:35.881695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:35.882482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:35.882482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:35.882482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:35.882482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:35.882482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:35.882482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:35.882482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:35.882482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:35.882482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:35.882482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:35.882482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:35.882482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:35.882482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 243/495] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:56:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:35.883180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5040871-4218-455d-b38e-df6f604d5d1d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:35.911569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:35.912541 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293acd2-8239-4963-8b46-f1e5b0438eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:35.913250 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293acd2-8239-4963-8b46-f1e5b0438eba None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:35.913532 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293acd2-8239-4963-8b46-f1e5b0438eba None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:35.913813 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293acd2-8239-4963-8b46-f1e5b0438eba None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:35.914636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293acd2-8239-4963-8b46-f1e5b0438eba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:35.914981 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293acd2-8239-4963-8b46-f1e5b0438eba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:35.916436 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293acd2-8239-4963-8b46-f1e5b0438eba None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:35.955265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 253/496] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Jul 11 11:56:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:35.956134 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293acd2-8239-4963-8b46-f1e5b0438eba None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:35.987940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5040871-4218-455d-b38e-df6f604d5d1d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:36.019909 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:36.022428 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3225e-3254-4941-a15b-b96bc51229ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:36.023244 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3225e-3254-4941-a15b-b96bc51229ec None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:36.023523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3225e-3254-4941-a15b-b96bc51229ec None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:36.023793 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3225e-3254-4941-a15b-b96bc51229ec None admin] PATH_INFO: `/v3/users/glance` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:36.031471 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3225e-3254-4941-a15b-b96bc51229ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:36.032965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3225e-3254-4941-a15b-b96bc51229ec None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:36.048589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-18e3225e-3254-4941-a15b-b96bc51229ec None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 11:56:36.048589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:36.048589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:36.048589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:36.048589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:36.048589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:36.048589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:36.048589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:36.048589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:36.048589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:36.048589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:36.048589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:36.048589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:56:36.048589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:56:36.048589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:56:36.048589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:36.049555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:36.050442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:36.050442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:36.050442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:56:36.050442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:56:36.050442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:56:36.050442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:56:36.050442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:56:36.050442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:56:36.050442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 11:56:36.050442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:36.050442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 244/497] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:36.051034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3225e-3254-4941-a15b-b96bc51229ec None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:36.056741 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293acd2-8239-4963-8b46-f1e5b0438eba None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:36.091909 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c304a4-244d-4b04-a742-6945981b3249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:36.092696 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c304a4-244d-4b04-a742-6945981b3249 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:36.092976 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c304a4-244d-4b04-a742-6945981b3249 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:36.093246 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c304a4-244d-4b04-a742-6945981b3249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:36.103474 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c304a4-244d-4b04-a742-6945981b3249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:36.104933 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c304a4-244d-4b04-a742-6945981b3249 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:36.122980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-a0c304a4-244d-4b04-a742-6945981b3249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:36.122980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:36.122980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:36.122980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:36.122980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:36.122980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:36.122980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:36.122980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:36.122980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:36.122980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:36.122980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:36.122980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:36.122980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:36.122980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:36.122980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:36.123883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:36.124712 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:36.124712 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:36.124712 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:36.124712 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:36.124712 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 254/498] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:36.125018 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c304a4-244d-4b04-a742-6945981b3249 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:36.145891 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:36.162228 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3225e-3254-4941-a15b-b96bc51229ec None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:36.196883 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecedd8-272f-47e5-a476-5a521615dc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:36.197537 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecedd8-272f-47e5-a476-5a521615dc7e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:36.197821 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecedd8-272f-47e5-a476-5a521615dc7e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:36.198185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecedd8-272f-47e5-a476-5a521615dc7e None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:36.199090 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cecedd8-272f-47e5-a476-5a521615dc7e None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:36.199395 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cecedd8-272f-47e5-a476-5a521615dc7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:36.200780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cecedd8-272f-47e5-a476-5a521615dc7e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:36.208972 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 245/499] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Jul 11 11:56:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:36.209693 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecedd8-272f-47e5-a476-5a521615dc7e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:36.234968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c304a4-244d-4b04-a742-6945981b3249 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:36.251797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:36.270774 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2af2f-9da6-4f89-abe2-1995ec57d5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:36.271354 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2af2f-9da6-4f89-abe2-1995ec57d5be None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:36.271637 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2af2f-9da6-4f89-abe2-1995ec57d5be None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:36.271909 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2af2f-9da6-4f89-abe2-1995ec57d5be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:36.307284 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecedd8-272f-47e5-a476-5a521615dc7e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:36.340164 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2af2f-9da6-4f89-abe2-1995ec57d5be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:36.341426 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc43ee-b7c2-48a7-b1f3-49bef7f6f0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:36.341635 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2af2f-9da6-4f89-abe2-1995ec57d5be None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:36.342077 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc43ee-b7c2-48a7-b1f3-49bef7f6f0fa None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:36.342356 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc43ee-b7c2-48a7-b1f3-49bef7f6f0fa None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:36.342627 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc43ee-b7c2-48a7-b1f3-49bef7f6f0fa None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:36.343476 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc43ee-b7c2-48a7-b1f3-49bef7f6f0fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:36.343785 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc43ee-b7c2-48a7-b1f3-49bef7f6f0fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:36.345196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc43ee-b7c2-48a7-b1f3-49bef7f6f0fa None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:36.382478 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 246/500] 10.222.0.25 () {56 vars in 1137 bytes} [Mon Jul 11 11:56:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:36.383860 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc43ee-b7c2-48a7-b1f3-49bef7f6f0fa None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:36.388638 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:36.445320 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 255/501] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:36.446165 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2af2f-9da6-4f89-abe2-1995ec57d5be None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:36.465847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:36.488709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc43ee-b7c2-48a7-b1f3-49bef7f6f0fa None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:36.522403 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891e187-a311-42ae-9ac7-ff0ff719db20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:36.523018 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891e187-a311-42ae-9ac7-ff0ff719db20 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:36.523306 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891e187-a311-42ae-9ac7-ff0ff719db20 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:36.523584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891e187-a311-42ae-9ac7-ff0ff719db20 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:36.524304 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891e187-a311-42ae-9ac7-ff0ff719db20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:36.524612 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891e187-a311-42ae-9ac7-ff0ff719db20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:36.525996 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891e187-a311-42ae-9ac7-ff0ff719db20 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:36.538388 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 247/502] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:36.539061 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891e187-a311-42ae-9ac7-ff0ff719db20 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:36.548068 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2af2f-9da6-4f89-abe2-1995ec57d5be None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:36.583657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f964ee-db79-4e09-a8e1-7ed801e9280c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:36.584452 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f964ee-db79-4e09-a8e1-7ed801e9280c None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:36.584739 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f964ee-db79-4e09-a8e1-7ed801e9280c None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:36.585022 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f964ee-db79-4e09-a8e1-7ed801e9280c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:36.595420 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f964ee-db79-4e09-a8e1-7ed801e9280c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:36.596876 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f964ee-db79-4e09-a8e1-7ed801e9280c None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:36.600525 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:36.614948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-92f964ee-db79-4e09-a8e1-7ed801e9280c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:36.614948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:36.614948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:36.614948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:36.614948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:36.614948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:36.614948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:36.614948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:36.614948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:36.614948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:36.614948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:36.614948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:36.614948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:36.614948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:36.614948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:36.615806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:36.616647 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:36.616647 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:36.616647 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:36.616647 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:36.616647 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 256/503] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:36.616906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f964ee-db79-4e09-a8e1-7ed801e9280c None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:36.640691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891e187-a311-42ae-9ac7-ff0ff719db20 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:36.674579 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b4a4e-b066-4aa7-bbc3-47c5d016985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:36.675242 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b4a4e-b066-4aa7-bbc3-47c5d016985b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:36.675520 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b4a4e-b066-4aa7-bbc3-47c5d016985b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:36.675788 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b4a4e-b066-4aa7-bbc3-47c5d016985b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:36.686204 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:36.721262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f964ee-db79-4e09-a8e1-7ed801e9280c None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:36.747441 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b4a4e-b066-4aa7-bbc3-47c5d016985b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:36.748905 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b4a4e-b066-4aa7-bbc3-47c5d016985b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:36.756496 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0c6e6-46f3-4592-a41d-37a50472f906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:36.757275 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0c6e6-46f3-4592-a41d-37a50472f906 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:36.757554 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0c6e6-46f3-4592-a41d-37a50472f906 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:36.757823 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0c6e6-46f3-4592-a41d-37a50472f906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:36.768687 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0c6e6-46f3-4592-a41d-37a50472f906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:36.770130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0c6e6-46f3-4592-a41d-37a50472f906 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:36.786688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-4fe0c6e6-46f3-4592-a41d-37a50472f906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:36.786688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:36.786688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:36.786688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:36.786688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:36.786688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:36.786688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:36.786688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:36.786688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:36.786688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:36.786688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:36.786688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:36.786688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:36.786688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:36.786688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:36.787531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:36.788444 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:36.788444 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:36.788444 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:36.788444 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:36.788444 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 257/504] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:36.788700 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0c6e6-46f3-4592-a41d-37a50472f906 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:36.810285 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:36.849946 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 248/505] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:36.850570 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b4a4e-b066-4aa7-bbc3-47c5d016985b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:36.888702 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0c6e6-46f3-4592-a41d-37a50472f906 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:36.911669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:36.925394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d58ef-0c5d-4005-8443-edb312c8d223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:36.926637 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d58ef-0c5d-4005-8443-edb312c8d223 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:36.927100 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d58ef-0c5d-4005-8443-edb312c8d223 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:36.927559 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d58ef-0c5d-4005-8443-edb312c8d223 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:36.935593 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d58ef-0c5d-4005-8443-edb312c8d223 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:36.937031 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d58ef-0c5d-4005-8443-edb312c8d223 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:36.951504 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b4a4e-b066-4aa7-bbc3-47c5d016985b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:36.952227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-2c2d58ef-0c5d-4005-8443-edb312c8d223 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 11:56:36.952227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:36.952227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:36.952227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:36.952227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:36.952227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:36.952227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:36.952227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:36.952227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:36.952227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:36.952227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:36.952227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:36.952227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:56:36.952227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:56:36.952227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:56:36.952227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:36.953196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:36.954062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:36.954062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:36.954062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:56:36.954062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:56:36.954062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:56:36.954062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:56:36.954062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:56:36.954062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:56:36.954062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 11:56:36.954062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:36.954062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 258/506] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:36.954619 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d58ef-0c5d-4005-8443-edb312c8d223 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:36.989915 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50c241-f9c3-43a2-af3b-963f31b4c2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:36.990568 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50c241-f9c3-43a2-af3b-963f31b4c2ce None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:36.990879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50c241-f9c3-43a2-af3b-963f31b4c2ce None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:36.991150 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50c241-f9c3-43a2-af3b-963f31b4c2ce None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:36.991858 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50c241-f9c3-43a2-af3b-963f31b4c2ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:36.992161 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50c241-f9c3-43a2-af3b-963f31b4c2ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:36.993545 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50c241-f9c3-43a2-af3b-963f31b4c2ce None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:37.005356 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 249/507] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:37.010516 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50c241-f9c3-43a2-af3b-963f31b4c2ce None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:37.037735 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:37.059445 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d58ef-0c5d-4005-8443-edb312c8d223 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:37.096881 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a691c87-5ada-4657-a8d7-4a84bee1a472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:37.097552 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a691c87-5ada-4657-a8d7-4a84bee1a472 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:37.097831 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a691c87-5ada-4657-a8d7-4a84bee1a472 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:37.098103 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a691c87-5ada-4657-a8d7-4a84bee1a472 None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:37.098850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a691c87-5ada-4657-a8d7-4a84bee1a472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:37.099160 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a691c87-5ada-4657-a8d7-4a84bee1a472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:37.100523 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a691c87-5ada-4657-a8d7-4a84bee1a472 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:37.112740 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 259/508] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:37.113620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a691c87-5ada-4657-a8d7-4a84bee1a472 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:37.120802 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50c241-f9c3-43a2-af3b-963f31b4c2ce None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:37.153838 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60cd23-1ec7-4286-8a4d-798485442a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:37.154610 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60cd23-1ec7-4286-8a4d-798485442a26 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:37.154927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60cd23-1ec7-4286-8a4d-798485442a26 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:37.155205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60cd23-1ec7-4286-8a4d-798485442a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:37.158844 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:37.166154 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60cd23-1ec7-4286-8a4d-798485442a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:37.168218 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60cd23-1ec7-4286-8a4d-798485442a26 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:37.186127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-0d60cd23-1ec7-4286-8a4d-798485442a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:37.186127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:37.186127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:37.186127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:37.186127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:37.186127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:37.186127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:37.186127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:37.186127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:37.186127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:37.186127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:37.186127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:37.186127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:37.186127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:37.186127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:37.187109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:37.187933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:37.187933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:37.187933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:37.187933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:37.187933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 250/509] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:37.188221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60cd23-1ec7-4286-8a4d-798485442a26 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:37.222056 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a691c87-5ada-4657-a8d7-4a84bee1a472 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:37.255439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0c8cb-4b84-4a01-9403-68c52fb98453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:37.256104 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0c8cb-4b84-4a01-9403-68c52fb98453 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:37.256383 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0c8cb-4b84-4a01-9403-68c52fb98453 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:37.256657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0c8cb-4b84-4a01-9403-68c52fb98453 None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:37.257471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0c8cb-4b84-4a01-9403-68c52fb98453 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:37.257777 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0c8cb-4b84-4a01-9403-68c52fb98453 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:37.259250 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0c8cb-4b84-4a01-9403-68c52fb98453 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:37.269361 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:37.276712 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 260/510] 10.222.0.25 () {56 vars in 1137 bytes} [Mon Jul 11 11:56:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:37.277420 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0c8cb-4b84-4a01-9403-68c52fb98453 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:37.294275 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60cd23-1ec7-4286-8a4d-798485442a26 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:37.329420 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893d813-fac3-4a7b-a798-b044a1a117c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:37.330213 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893d813-fac3-4a7b-a798-b044a1a117c3 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:37.330496 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893d813-fac3-4a7b-a798-b044a1a117c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:37.330814 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893d813-fac3-4a7b-a798-b044a1a117c3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:37.338248 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893d813-fac3-4a7b-a798-b044a1a117c3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:37.340673 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893d813-fac3-4a7b-a798-b044a1a117c3 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:37.355129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-7893d813-fac3-4a7b-a798-b044a1a117c3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 11:56:37.355129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:37.355129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:37.355129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:37.355129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:37.355129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:37.355129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:37.355129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:37.355129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:37.355129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:37.355129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:37.355129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:37.355129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:56:37.355129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:56:37.355129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:56:37.355129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:37.356005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:37.356861 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:37.356861 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:37.356861 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:56:37.356861 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:56:37.356861 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:56:37.356861 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:56:37.356861 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:56:37.356861 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:56:37.356861 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 11:56:37.356861 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:37.356861 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 251/511] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:56:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:37.357410 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893d813-fac3-4a7b-a798-b044a1a117c3 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:37.378113 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:37.384989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0c8cb-4b84-4a01-9403-68c52fb98453 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:37.423659 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc4f5d-c591-40d7-ade4-23e99514e326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:37.426699 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4f5d-c591-40d7-ade4-23e99514e326 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:37.426699 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4f5d-c591-40d7-ade4-23e99514e326 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:37.426699 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4f5d-c591-40d7-ade4-23e99514e326 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:37.434590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc4f5d-c591-40d7-ade4-23e99514e326 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:37.436072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc4f5d-c591-40d7-ade4-23e99514e326 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:37.450990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-08bc4f5d-c591-40d7-ade4-23e99514e326 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:37.450990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:37.450990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:37.450990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:37.450990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:37.450990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:37.450990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:37.450990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:37.450990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:37.450990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:37.450990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:37.450990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:37.450990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:56:37.450990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:56:37.450990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:37.451904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:37.452753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:56:37.452753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:56:37.452753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:56:37.452753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:56:37.452753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:56:37.452753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:56:37.452753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:37.452753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:37.452753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 261/512] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:37.453232 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc4f5d-c591-40d7-ade4-23e99514e326 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:37.476843 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893d813-fac3-4a7b-a798-b044a1a117c3 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:37.511351 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa56e4-256c-4dad-b747-4bd344c02a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:37.512014 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa56e4-256c-4dad-b747-4bd344c02a60 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:37.512293 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa56e4-256c-4dad-b747-4bd344c02a60 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:37.512563 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa56e4-256c-4dad-b747-4bd344c02a60 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:37.513336 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa56e4-256c-4dad-b747-4bd344c02a60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:37.513775 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa56e4-256c-4dad-b747-4bd344c02a60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:37.515997 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa56e4-256c-4dad-b747-4bd344c02a60 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:37.518443 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:37.530593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 252/513] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:37.531475 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa56e4-256c-4dad-b747-4bd344c02a60 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:37.556977 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc4f5d-c591-40d7-ade4-23e99514e326 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:37.598323 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6bee5-ec3a-4825-93ea-e1a8cb562b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:37.599011 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6bee5-ec3a-4825-93ea-e1a8cb562b80 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:37.599290 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6bee5-ec3a-4825-93ea-e1a8cb562b80 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:37.599565 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6bee5-ec3a-4825-93ea-e1a8cb562b80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:37.634792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:37.647476 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa56e4-256c-4dad-b747-4bd344c02a60 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:37.677231 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6bee5-ec3a-4825-93ea-e1a8cb562b80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:37.678897 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6bee5-ec3a-4825-93ea-e1a8cb562b80 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:37.686127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16df40-fbf4-4d4f-a985-a97e35e9abf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:37.686827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16df40-fbf4-4d4f-a985-a97e35e9abf6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:37.687135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16df40-fbf4-4d4f-a985-a97e35e9abf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:37.687409 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16df40-fbf4-4d4f-a985-a97e35e9abf6 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:37.688250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16df40-fbf4-4d4f-a985-a97e35e9abf6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:37.688558 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16df40-fbf4-4d4f-a985-a97e35e9abf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:37.690004 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16df40-fbf4-4d4f-a985-a97e35e9abf6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:37.708868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 253/514] 10.222.0.25 () {56 vars in 1139 bytes} [Mon Jul 11 11:56:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:37.709707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16df40-fbf4-4d4f-a985-a97e35e9abf6 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:37.773387 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:37.809714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 262/515] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:37.810495 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6bee5-ec3a-4825-93ea-e1a8cb562b80 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:37.827974 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16df40-fbf4-4d4f-a985-a97e35e9abf6 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:37.876094 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd92a6-5b15-48a1-9eab-4f43de68011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:37.877029 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd92a6-5b15-48a1-9eab-4f43de68011a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:37.877531 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd92a6-5b15-48a1-9eab-4f43de68011a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:37.878025 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd92a6-5b15-48a1-9eab-4f43de68011a None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:37.879021 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd92a6-5b15-48a1-9eab-4f43de68011a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:37.879332 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd92a6-5b15-48a1-9eab-4f43de68011a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:37.880829 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd92a6-5b15-48a1-9eab-4f43de68011a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:37.882892 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:37.901022 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 254/516] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:56:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:37.903055 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd92a6-5b15-48a1-9eab-4f43de68011a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:37.926764 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6bee5-ec3a-4825-93ea-e1a8cb562b80 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:37.961185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56e196-765f-4e95-87aa-33530209184c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:37.961977 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56e196-765f-4e95-87aa-33530209184c None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:37.962260 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56e196-765f-4e95-87aa-33530209184c None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:37.962536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56e196-765f-4e95-87aa-33530209184c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:37.974878 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56e196-765f-4e95-87aa-33530209184c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:37.976363 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56e196-765f-4e95-87aa-33530209184c None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:37.992965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-8f56e196-765f-4e95-87aa-33530209184c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:37.992965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:37.992965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:37.992965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:37.992965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:37.992965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:37.992965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:37.992965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:37.992965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:37.992965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:37.992965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:37.992965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:37.992965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:56:37.992965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:56:37.992965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:37.994575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:37.996765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:56:37.996765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:56:37.996765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:56:37.996765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:56:37.996765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:56:37.996765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:56:37.996765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:37.996765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:37.996765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 263/517] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:38.000627 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56e196-765f-4e95-87aa-33530209184c None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:38.035860 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd92a6-5b15-48a1-9eab-4f43de68011a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:38.052453 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:38.077875 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31746877-0902-4bc0-ac84-b439337acbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:38.078444 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31746877-0902-4bc0-ac84-b439337acbbd None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:38.078762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31746877-0902-4bc0-ac84-b439337acbbd None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:38.079046 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31746877-0902-4bc0-ac84-b439337acbbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:38.128138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56e196-765f-4e95-87aa-33530209184c None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:38.156400 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:38.160283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31746877-0902-4bc0-ac84-b439337acbbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:38.161784 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31746877-0902-4bc0-ac84-b439337acbbd None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:38.183466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ad50-7a41-42da-8859-fdf700b78be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:38.184295 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ad50-7a41-42da-8859-fdf700b78be7 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:38.184630 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ad50-7a41-42da-8859-fdf700b78be7 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:38.184937 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ad50-7a41-42da-8859-fdf700b78be7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:38.196257 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194ad50-7a41-42da-8859-fdf700b78be7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:38.197724 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194ad50-7a41-42da-8859-fdf700b78be7 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:38.218348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-4194ad50-7a41-42da-8859-fdf700b78be7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:38.218348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:38.218348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:38.218348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:38.218348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:38.218348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:38.218348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:38.218348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:38.218348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:38.218348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:38.218348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:38.218348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:38.218348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:38.218348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:38.218348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:38.224382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:38.226679 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:38.226679 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:38.226679 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:38.226679 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:38.226679 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 264/518] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:38.226679 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ad50-7a41-42da-8859-fdf700b78be7 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:38.288255 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 255/519] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:38.289534 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31746877-0902-4bc0-ac84-b439337acbbd None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:38.309982 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:38.340544 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ad50-7a41-42da-8859-fdf700b78be7 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:38.375075 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9e79c-7a0c-4248-abb8-ef2632fe255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:38.375843 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9e79c-7a0c-4248-abb8-ef2632fe255d None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:38.376257 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9e79c-7a0c-4248-abb8-ef2632fe255d None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:38.376539 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9e79c-7a0c-4248-abb8-ef2632fe255d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:38.377372 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9e79c-7a0c-4248-abb8-ef2632fe255d None admin] RBAC: Adding query filter params (role.id=22d318004ece47b3a0d4d3919bfebdc9, scope.project.id=6e452080fec045788d9bd5dfdb7a3c52, user.id=11550a0ca11041b0b9b175860f2b6633) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:38.377686 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9e79c-7a0c-4248-abb8-ef2632fe255d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:38.379158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9e79c-7a0c-4248-abb8-ef2632fe255d None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:38.384672 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 265/520] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:56:38 2022] GET /identity/v3/role_assignments?user.id=11550a0ca11041b0b9b175860f2b6633&scope.project.id=6e452080fec045788d9bd5dfdb7a3c52&role.id=22d318004ece47b3a0d4d3919bfebdc9 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:38.385465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9e79c-7a0c-4248-abb8-ef2632fe255d None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:38.397918 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31746877-0902-4bc0-ac84-b439337acbbd None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:38.427210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:38.440180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb66c3-c724-4cc8-8bf2-46e31ba3b771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:38.440853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb66c3-c724-4cc8-8bf2-46e31ba3b771 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:38.441139 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb66c3-c724-4cc8-8bf2-46e31ba3b771 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:38.441416 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb66c3-c724-4cc8-8bf2-46e31ba3b771 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:38.442219 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb66c3-c724-4cc8-8bf2-46e31ba3b771 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:38.442636 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb66c3-c724-4cc8-8bf2-46e31ba3b771 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:38.444196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb66c3-c724-4cc8-8bf2-46e31ba3b771 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:38.457745 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 256/521] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:56:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:38.458665 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb66c3-c724-4cc8-8bf2-46e31ba3b771 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:38.512192 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9e79c-7a0c-4248-abb8-ef2632fe255d None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:38.552451 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390c86d-874c-45ad-9315-766e9370870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:38.553117 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390c86d-874c-45ad-9315-766e9370870b None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:38.553396 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390c86d-874c-45ad-9315-766e9370870b None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:38.553666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390c86d-874c-45ad-9315-766e9370870b None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:38.554387 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390c86d-874c-45ad-9315-766e9370870b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:38.554688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390c86d-874c-45ad-9315-766e9370870b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:38.556108 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390c86d-874c-45ad-9315-766e9370870b None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:38.556603 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:38.582511 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 266/522] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:38.582511 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390c86d-874c-45ad-9315-766e9370870b None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:38.584911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb66c3-c724-4cc8-8bf2-46e31ba3b771 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:38.621871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23ca23-09db-47c2-8657-efef334a9497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:38.622970 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23ca23-09db-47c2-8657-efef334a9497 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:38.623254 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23ca23-09db-47c2-8657-efef334a9497 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:38.623525 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23ca23-09db-47c2-8657-efef334a9497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:38.636197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23ca23-09db-47c2-8657-efef334a9497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:38.637805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23ca23-09db-47c2-8657-efef334a9497 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:38.656087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-dd23ca23-09db-47c2-8657-efef334a9497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:38.656087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:38.656087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:38.656087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:38.656087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:38.656087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:38.656087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:38.656087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:38.656087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:38.656087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:38.656087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:38.656087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:38.656087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:38.656087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:38.656087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:38.656963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:38.657826 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:38.657826 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:38.657826 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:38.657826 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:38.657826 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 257/523] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:38.658096 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23ca23-09db-47c2-8657-efef334a9497 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:38.691711 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:38.699422 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390c86d-874c-45ad-9315-766e9370870b None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:38.738322 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab5696-7634-4a87-9e6c-31f7e9924530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:38.739017 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab5696-7634-4a87-9e6c-31f7e9924530 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:38.739556 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab5696-7634-4a87-9e6c-31f7e9924530 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:38.739556 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab5696-7634-4a87-9e6c-31f7e9924530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:38.740381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab5696-7634-4a87-9e6c-31f7e9924530 None admin] RBAC: Adding query filter params (role.id=22d318004ece47b3a0d4d3919bfebdc9, scope.project.id=6e452080fec045788d9bd5dfdb7a3c52, user.id=dce9ec24be9049bfacddcf3c068f2f65) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:38.740698 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab5696-7634-4a87-9e6c-31f7e9924530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:38.742137 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab5696-7634-4a87-9e6c-31f7e9924530 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:38.754805 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 267/524] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:56:38 2022] GET /identity/v3/role_assignments?user.id=dce9ec24be9049bfacddcf3c068f2f65&scope.project.id=6e452080fec045788d9bd5dfdb7a3c52&role.id=22d318004ece47b3a0d4d3919bfebdc9 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:38.754805 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab5696-7634-4a87-9e6c-31f7e9924530 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:38.775758 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23ca23-09db-47c2-8657-efef334a9497 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:38.808457 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:38.820776 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bf387-8003-4ff1-911d-adba26a36d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:38.821570 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bf387-8003-4ff1-911d-adba26a36d92 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:38.821850 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bf387-8003-4ff1-911d-adba26a36d92 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:38.822124 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bf387-8003-4ff1-911d-adba26a36d92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:38.834383 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7bf387-8003-4ff1-911d-adba26a36d92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:38.836557 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7bf387-8003-4ff1-911d-adba26a36d92 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:38.857298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-4a7bf387-8003-4ff1-911d-adba26a36d92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:38.857298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:38.857298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:38.857298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:38.857298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:38.857298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:38.857298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:38.857298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:38.857298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:38.857298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:38.857298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:38.857298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:38.857298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:56:38.857298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:56:38.857298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:38.858341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:38.859216 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:56:38.859216 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:56:38.859216 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:56:38.859216 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:56:38.859216 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:56:38.859216 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:56:38.859216 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:38.859216 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:38.859216 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 258/525] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:38.865391 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bf387-8003-4ff1-911d-adba26a36d92 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:38.886266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab5696-7634-4a87-9e6c-31f7e9924530 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:38.935639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196df67-7189-4c27-a3a3-a1451e2e0d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:38.937367 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196df67-7189-4c27-a3a3-a1451e2e0d59 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:38.938148 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196df67-7189-4c27-a3a3-a1451e2e0d59 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:38.938652 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196df67-7189-4c27-a3a3-a1451e2e0d59 None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:38.939906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196df67-7189-4c27-a3a3-a1451e2e0d59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:38.940969 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196df67-7189-4c27-a3a3-a1451e2e0d59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:38.943224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196df67-7189-4c27-a3a3-a1451e2e0d59 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:38.959709 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 268/526] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:38.965853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196df67-7189-4c27-a3a3-a1451e2e0d59 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:38.990466 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bf387-8003-4ff1-911d-adba26a36d92 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:39.012824 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:39.026681 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4270994-5693-4ac8-9cf6-26012557e7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:39.027455 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4270994-5693-4ac8-9cf6-26012557e7bf None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:39.027809 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4270994-5693-4ac8-9cf6-26012557e7bf None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:39.028155 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4270994-5693-4ac8-9cf6-26012557e7bf None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:39.028998 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4270994-5693-4ac8-9cf6-26012557e7bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:39.029383 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4270994-5693-4ac8-9cf6-26012557e7bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:39.030980 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4270994-5693-4ac8-9cf6-26012557e7bf None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:39.049328 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 259/527] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:56:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:39.050795 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4270994-5693-4ac8-9cf6-26012557e7bf None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:39.095507 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196df67-7189-4c27-a3a3-a1451e2e0d59 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:39.122928 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:39.146706 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d260b0-56c1-43bc-aeaa-d01c23a00b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:39.147749 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d260b0-56c1-43bc-aeaa-d01c23a00b69 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:39.148044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d260b0-56c1-43bc-aeaa-d01c23a00b69 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:39.148462 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d260b0-56c1-43bc-aeaa-d01c23a00b69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:39.157939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d260b0-56c1-43bc-aeaa-d01c23a00b69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:39.160262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d260b0-56c1-43bc-aeaa-d01c23a00b69 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:39.177972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-92d260b0-56c1-43bc-aeaa-d01c23a00b69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:39.177972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:39.177972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:39.177972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:39.177972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:39.177972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:39.177972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:39.177972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:39.177972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:39.177972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:39.177972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:39.177972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:39.177972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:56:39.177972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:56:39.177972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:39.179112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:39.179974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:56:39.179974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:56:39.179974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:56:39.179974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:56:39.179974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:56:39.179974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:56:39.179974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:39.179974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:39.179974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 269/528] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:39.184888 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d260b0-56c1-43bc-aeaa-d01c23a00b69 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:39.204722 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4270994-5693-4ac8-9cf6-26012557e7bf None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:39.246886 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984c687-3077-40be-80ad-73041c55a699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:39.247551 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984c687-3077-40be-80ad-73041c55a699 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:39.247835 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984c687-3077-40be-80ad-73041c55a699 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:39.248115 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984c687-3077-40be-80ad-73041c55a699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:39.248950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984c687-3077-40be-80ad-73041c55a699 None admin] RBAC: Adding query filter params (role.id=22d318004ece47b3a0d4d3919bfebdc9, scope.project.id=6e452080fec045788d9bd5dfdb7a3c52, user.id=009ac389925143f1954c5d1971155318) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:39.249264 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984c687-3077-40be-80ad-73041c55a699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:39.251331 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984c687-3077-40be-80ad-73041c55a699 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:39.263168 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 260/529] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:56:39 2022] GET /identity/v3/role_assignments?user.id=009ac389925143f1954c5d1971155318&scope.project.id=6e452080fec045788d9bd5dfdb7a3c52&role.id=22d318004ece47b3a0d4d3919bfebdc9 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:39.284444 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:39.309063 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d260b0-56c1-43bc-aeaa-d01c23a00b69 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:39.351048 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4107c-5192-4931-96d8-6c24db2ba4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:39.352093 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4107c-5192-4931-96d8-6c24db2ba4c2 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:39.352581 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4107c-5192-4931-96d8-6c24db2ba4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:39.353082 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4107c-5192-4931-96d8-6c24db2ba4c2 None admin] PATH_INFO: `/v3/projects` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:39.355033 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4107c-5192-4931-96d8-6c24db2ba4c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:39.355722 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4107c-5192-4931-96d8-6c24db2ba4c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:39.357429 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4107c-5192-4931-96d8-6c24db2ba4c2 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:39.379014 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 270/530] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:56:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:39.390409 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984c687-3077-40be-80ad-73041c55a699 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:39.502452 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984c687-3077-40be-80ad-73041c55a699 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:39.513631 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:39.538215 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edf66a-c370-4094-8d16-e28d33da9789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:39.538919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edf66a-c370-4094-8d16-e28d33da9789 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:39.539207 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edf66a-c370-4094-8d16-e28d33da9789 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:39.539484 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edf66a-c370-4094-8d16-e28d33da9789 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:39.540336 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edf66a-c370-4094-8d16-e28d33da9789 None admin] RBAC: Adding query filter params (role.id=22d318004ece47b3a0d4d3919bfebdc9, scope.project.id=6e452080fec045788d9bd5dfdb7a3c52, user.id=2b005858b98e4e27b2536d9ea3908f09) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:39.540652 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edf66a-c370-4094-8d16-e28d33da9789 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:39.542736 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edf66a-c370-4094-8d16-e28d33da9789 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:39.549825 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 261/531] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:56:39 2022] GET /identity/v3/role_assignments?user.id=2b005858b98e4e27b2536d9ea3908f09&scope.project.id=6e452080fec045788d9bd5dfdb7a3c52&role.id=22d318004ece47b3a0d4d3919bfebdc9 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:40.648983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b447c-f832-4fce-bf75-d54141b33724 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:40.649489 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b447c-f832-4fce-bf75-d54141b33724 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:40.649565 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b447c-f832-4fce-bf75-d54141b33724 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:40.651184 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 271/532] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:40.656746 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b3ac5-c77a-4236-b1d6-a76ad469af92 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:40.657227 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b3ac5-c77a-4236-b1d6-a76ad469af92 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:40.657303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b3ac5-c77a-4236-b1d6-a76ad469af92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:40.674287 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-321b3ac5-c77a-4236-b1d6-a76ad469af92 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:40.675507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-321b3ac5-c77a-4236-b1d6-a76ad469af92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:40.750070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 262/533] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:40.774498 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b447c-f832-4fce-bf75-d54141b33724 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:40.882951 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b447c-f832-4fce-bf75-d54141b33724 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:40.921625 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ed478-e08c-4bd0-8af7-806cc144ad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:40.922362 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ed478-e08c-4bd0-8af7-806cc144ad06 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:40.922644 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ed478-e08c-4bd0-8af7-806cc144ad06 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:40.922951 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ed478-e08c-4bd0-8af7-806cc144ad06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:40.933293 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:40.936690 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ed478-e08c-4bd0-8af7-806cc144ad06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:40.944994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-650ed478-e08c-4bd0-8af7-806cc144ad06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:40.944994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:40.944994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:40.944994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:40.944994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:40.944994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:40.944994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:40.944994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:40.944994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:40.944994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:40.944994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:40.944994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:40.944994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:40.944994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:40.944994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:40.944994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:40.945943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:40.945943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:40.945943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:40.945943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:40.945943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:40.945943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:40.945943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:40.945943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:40.945943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:40.945943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:40.945943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:40.945943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:40.945943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:40.945943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:40.945943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:40.945943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:40.946754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:40.946754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:40.946754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:40.946754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:40.946754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:40.946754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:40.946754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:40.946754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:40.946754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:40.946754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:40.946754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:40.946754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:40.946754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 272/534] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:56:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:40.955044 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b3ac5-c77a-4236-b1d6-a76ad469af92 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:41.062253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b3ac5-c77a-4236-b1d6-a76ad469af92 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:41.065653 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:41.097341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44415bfa-6caa-4dc8-b967-607c2e0060de None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:41.097646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44415bfa-6caa-4dc8-b967-607c2e0060de None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:41.097915 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44415bfa-6caa-4dc8-b967-607c2e0060de None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:41.099215 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464d407-20a3-42ce-bb46-90ea827359e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:41.099554 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 273/535] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:41.100259 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464d407-20a3-42ce-bb46-90ea827359e5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:41.100632 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464d407-20a3-42ce-bb46-90ea827359e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:41.100915 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464d407-20a3-42ce-bb46-90ea827359e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:41.101660 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464d407-20a3-42ce-bb46-90ea827359e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:41.101967 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464d407-20a3-42ce-bb46-90ea827359e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:41.106733 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464d407-20a3-42ce-bb46-90ea827359e5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:41.106854 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403a083-1971-4af3-bf2f-27a69dc8d482 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:41.106854 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403a083-1971-4af3-bf2f-27a69dc8d482 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:41.106854 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403a083-1971-4af3-bf2f-27a69dc8d482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:41.114177 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 263/536] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Jul 11 11:56:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:41.119743 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464d407-20a3-42ce-bb46-90ea827359e5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:41.125150 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-a403a083-1971-4af3-bf2f-27a69dc8d482 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:41.126342 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-a403a083-1971-4af3-bf2f-27a69dc8d482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:41.214407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 274/537] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:41.238113 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403a083-1971-4af3-bf2f-27a69dc8d482 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:41.246368 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464d407-20a3-42ce-bb46-90ea827359e5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:41.285595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f85b49-eba5-45e4-93ce-5319cc2b7d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:41.286687 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f85b49-eba5-45e4-93ce-5319cc2b7d1f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:41.287003 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f85b49-eba5-45e4-93ce-5319cc2b7d1f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:41.287283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f85b49-eba5-45e4-93ce-5319cc2b7d1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:41.304435 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f85b49-eba5-45e4-93ce-5319cc2b7d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:41.306577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f85b49-eba5-45e4-93ce-5319cc2b7d1f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:41.332132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-15f85b49-eba5-45e4-93ce-5319cc2b7d1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:41.332132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:41.332132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:41.332132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:41.332132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:41.332132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:41.332132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:41.332132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:41.332132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:41.332132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:41.332132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:41.332132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:41.332132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:41.332132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:41.332132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:41.333011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:41.333849 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:41.333849 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:41.333849 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:41.333849 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:41.338532 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 264/538] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:41.339442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f85b49-eba5-45e4-93ce-5319cc2b7d1f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:41.352791 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403a083-1971-4af3-bf2f-27a69dc8d482 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:41.366127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:41.386584 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:41.393575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524ff79-a945-4c4e-a5ef-99d85979efbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:41.394628 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524ff79-a945-4c4e-a5ef-99d85979efbf None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:41.395181 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524ff79-a945-4c4e-a5ef-99d85979efbf None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:41.395763 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524ff79-a945-4c4e-a5ef-99d85979efbf None admin] PATH_INFO: `/v3/roles/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:41.408142 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524ff79-a945-4c4e-a5ef-99d85979efbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:41.416314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-3524ff79-a945-4c4e-a5ef-99d85979efbf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:41.416314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:41.416314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:41.416314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:41.416314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:41.416314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:41.416314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:41.416314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:41.416314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:41.416314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:41.416314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:41.416314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:41.416314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:41.416314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:41.416314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:41.416314 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:41.417833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:41.417833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:41.417833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:41.417833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:41.417833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:41.417833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:41.417833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:41.417833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:41.417833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:41.417833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:41.417833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:41.417833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:41.417833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:41.417833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:41.417833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:41.417833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:41.418924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:41.418924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:41.418924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:41.418924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:41.418924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:41.418924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:41.418924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:41.418924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:41.418924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:41.418924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:41.418924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:41.418924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:41.418924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 275/539] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:56:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:41.427995 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524ff79-a945-4c4e-a5ef-99d85979efbf None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:41.487799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f85b49-eba5-45e4-93ce-5319cc2b7d1f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:41.530496 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa72c0-102e-4b11-9338-5082ba5cd606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:41.531540 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa72c0-102e-4b11-9338-5082ba5cd606 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:41.532238 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa72c0-102e-4b11-9338-5082ba5cd606 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:41.532693 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa72c0-102e-4b11-9338-5082ba5cd606 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:41.533619 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa72c0-102e-4b11-9338-5082ba5cd606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:41.534113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa72c0-102e-4b11-9338-5082ba5cd606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:41.535733 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa72c0-102e-4b11-9338-5082ba5cd606 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:41.550586 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 265/540] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:41.555600 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa72c0-102e-4b11-9338-5082ba5cd606 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:41.563582 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524ff79-a945-4c4e-a5ef-99d85979efbf None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:41.598913 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716954a6-6ab7-410f-8791-cefd94fd0739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:41.599596 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716954a6-6ab7-410f-8791-cefd94fd0739 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:41.599867 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716954a6-6ab7-410f-8791-cefd94fd0739 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:41.600151 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716954a6-6ab7-410f-8791-cefd94fd0739 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:41.600920 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716954a6-6ab7-410f-8791-cefd94fd0739 None admin] RBAC: Adding query filter params (name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:41.601482 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716954a6-6ab7-410f-8791-cefd94fd0739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:41.602587 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716954a6-6ab7-410f-8791-cefd94fd0739 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:41.616517 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 276/541] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Jul 11 11:56:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:41.618555 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716954a6-6ab7-410f-8791-cefd94fd0739 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:41.656270 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:41.688713 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa72c0-102e-4b11-9338-5082ba5cd606 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:41.692880 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:41.727920 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1760c6-78c1-4ab2-b6b6-27010234842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:41.729580 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1760c6-78c1-4ab2-b6b6-27010234842e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:41.730482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1760c6-78c1-4ab2-b6b6-27010234842e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:41.730906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1760c6-78c1-4ab2-b6b6-27010234842e None admin] PATH_INFO: `/v3/users/nova` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:41.738520 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1760c6-78c1-4ab2-b6b6-27010234842e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:41.740035 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1760c6-78c1-4ab2-b6b6-27010234842e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:41.748864 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716954a6-6ab7-410f-8791-cefd94fd0739 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:41.755927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-fe1760c6-78c1-4ab2-b6b6-27010234842e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:56:41.755927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:41.755927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:41.755927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:41.755927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:41.755927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:41.755927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:41.755927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:41.755927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:41.755927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:41.755927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:41.755927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:41.755927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:56:41.755927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:56:41.755927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:56:41.755927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:41.756962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:41.757955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:41.757955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:41.757955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:56:41.757955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:56:41.757955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:56:41.757955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:56:41.757955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:56:41.757955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:56:41.757955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:56:41.757955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:41.757955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 266/542] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Jul 11 11:56:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:41.758646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40da98-40bc-46de-8d5b-82f3159dcaaa None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:41.758970 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40da98-40bc-46de-8d5b-82f3159dcaaa None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:41.759239 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40da98-40bc-46de-8d5b-82f3159dcaaa None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:41.765267 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 267/543] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:41.766090 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40da98-40bc-46de-8d5b-82f3159dcaaa None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:41.793353 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a840c-3c50-4df1-97a3-9ea116f8fbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:41.794161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a840c-3c50-4df1-97a3-9ea116f8fbbf None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:41.794452 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a840c-3c50-4df1-97a3-9ea116f8fbbf None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:41.794810 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a840c-3c50-4df1-97a3-9ea116f8fbbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:41.806643 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a840c-3c50-4df1-97a3-9ea116f8fbbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:41.809022 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a840c-3c50-4df1-97a3-9ea116f8fbbf None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:41.828015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-d74a840c-3c50-4df1-97a3-9ea116f8fbbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:41.828015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:41.828015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:41.828015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:41.828015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:41.828015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:41.828015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:41.828015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:41.828015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:41.828015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:41.828015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:41.828015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:41.828015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:41.828015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:41.828015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:41.828955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:41.829791 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:41.829791 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:41.829791 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:41.829791 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:41.829791 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 277/544] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:41.830401 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415710cc-52b4-45d3-9b22-1f2f9609daf6 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:41.830643 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415710cc-52b4-45d3-9b22-1f2f9609daf6 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:41.831026 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415710cc-52b4-45d3-9b22-1f2f9609daf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:41.847375 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-415710cc-52b4-45d3-9b22-1f2f9609daf6 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:41.848543 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-415710cc-52b4-45d3-9b22-1f2f9609daf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:41.882731 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40da98-40bc-46de-8d5b-82f3159dcaaa None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:41.917801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 278/545] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:41.918196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1e069-c6ac-4088-a3ad-49ffef362189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:41.918941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1e069-c6ac-4088-a3ad-49ffef362189 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:41.919231 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1e069-c6ac-4088-a3ad-49ffef362189 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:41.919388 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e25d7-bf9e-4c45-9cd0-a4a7d977bac2 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:41.919555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1e069-c6ac-4088-a3ad-49ffef362189 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:41.919664 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e25d7-bf9e-4c45-9cd0-a4a7d977bac2 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:41.919933 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e25d7-bf9e-4c45-9cd0-a4a7d977bac2 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:41.920333 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1e069-c6ac-4088-a3ad-49ffef362189 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:41.920644 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1e069-c6ac-4088-a3ad-49ffef362189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:41.921319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 279/546] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:41.921858 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e25d7-bf9e-4c45-9cd0-a4a7d977bac2 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:41.922097 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1e069-c6ac-4088-a3ad-49ffef362189 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:41.946027 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:41.956794 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 268/547] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Jul 11 11:56:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:41.957586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:41.958048 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e564b-565b-4976-828a-14d738f8938b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:41.958339 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e564b-565b-4976-828a-14d738f8938b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:41.958617 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e564b-565b-4976-828a-14d738f8938b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:41.975610 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-841e564b-565b-4976-828a-14d738f8938b None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:41.976795 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-841e564b-565b-4976-828a-14d738f8938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:42.025525 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e25d7-bf9e-4c45-9cd0-a4a7d977bac2 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:42.044075 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 269/548] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:42.044908 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e564b-565b-4976-828a-14d738f8938b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:42.059939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ece0e-edce-44ce-9425-38df1f415932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:42.060598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ece0e-edce-44ce-9425-38df1f415932 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:42.060881 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ece0e-edce-44ce-9425-38df1f415932 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:42.061153 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ece0e-edce-44ce-9425-38df1f415932 None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:42.061867 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ece0e-edce-44ce-9425-38df1f415932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:42.062172 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ece0e-edce-44ce-9425-38df1f415932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:42.063572 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ece0e-edce-44ce-9425-38df1f415932 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:42.075163 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 280/549] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:42.075964 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ece0e-edce-44ce-9425-38df1f415932 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:42.162396 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e564b-565b-4976-828a-14d738f8938b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:42.168885 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:42.176999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ece0e-edce-44ce-9425-38df1f415932 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:42.195815 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:42.207455 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e71593-97d2-4f47-974e-c786082424e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:42.208252 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e71593-97d2-4f47-974e-c786082424e6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:42.208535 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e71593-97d2-4f47-974e-c786082424e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:42.208801 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e71593-97d2-4f47-974e-c786082424e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:42.216567 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd85dbe-5e2f-4078-abbe-c43967e7d6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:42.217352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd85dbe-5e2f-4078-abbe-c43967e7d6d5 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:42.217634 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd85dbe-5e2f-4078-abbe-c43967e7d6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:42.217907 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd85dbe-5e2f-4078-abbe-c43967e7d6d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:42.218986 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e71593-97d2-4f47-974e-c786082424e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:42.226584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-c3e71593-97d2-4f47-974e-c786082424e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:42.226584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:42.226584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:42.226584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:42.226584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:42.226584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:42.226584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:42.226584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:42.226584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:42.226584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:42.226584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:42.226584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:42.226584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:42.226584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:42.226584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:42.226584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:42.227666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:42.227666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:42.227666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:42.227666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:42.227666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:42.227666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:42.227666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:42.227666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:42.227666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:42.227666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:42.227666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:42.227666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:42.227666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:42.227666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:42.227666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:42.227666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:42.228767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:42.228767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:42.228767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:42.228767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:42.228767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:42.228767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:42.228767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:42.228767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:42.228767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:42.228767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:42.228767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:42.228767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:42.228767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 270/550] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:56:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:42.229505 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e71593-97d2-4f47-974e-c786082424e6 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:42.229577 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd85dbe-5e2f-4078-abbe-c43967e7d6d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:42.231218 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd85dbe-5e2f-4078-abbe-c43967e7d6d5 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:42.249309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-1bd85dbe-5e2f-4078-abbe-c43967e7d6d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:42.249309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:42.249309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:42.249309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:42.249309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:42.249309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:42.249309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:42.249309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:42.249309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:42.249309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:42.249309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:42.249309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:42.249309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:42.249309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:42.249309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:42.250269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:42.252407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:42.252407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:42.252407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:42.252407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:42.252407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 281/551] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:42.252407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd85dbe-5e2f-4078-abbe-c43967e7d6d5 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:42.331186 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e71593-97d2-4f47-974e-c786082424e6 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:42.349330 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd85dbe-5e2f-4078-abbe-c43967e7d6d5 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:42.364301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dc42c-c505-45cf-9f5c-faaff1887b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:42.365080 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc42c-c505-45cf-9f5c-faaff1887b1c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:42.365359 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc42c-c505-45cf-9f5c-faaff1887b1c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:42.365630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc42c-c505-45cf-9f5c-faaff1887b1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:42.376332 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dc42c-c505-45cf-9f5c-faaff1887b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:42.383906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-488dc42c-c505-45cf-9f5c-faaff1887b1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:42.383906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:42.383906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:42.383906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:42.383906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:42.383906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:42.383906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:42.383906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:42.383906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:42.383906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:42.383906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:42.383906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:42.383906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:42.383906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:42.383906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:42.383906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:42.385179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:42.385179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:42.385179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:42.385179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:42.385179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:42.385179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:42.385179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:42.385179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:42.385179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:42.385179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:42.385179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:42.385179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:42.385179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:42.385179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:42.385179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:42.385179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:42.386391 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:42.386391 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:42.386391 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:42.386391 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:42.386391 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:42.386391 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:42.386391 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:42.386391 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:42.386391 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:42.386391 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:42.386391 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:42.386391 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:42.387058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc0f3b-fc78-4274-be7f-32451e6bfadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:42.387157 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 271/552] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:56:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:42.387230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc0f3b-fc78-4274-be7f-32451e6bfadd None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:42.387230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc0f3b-fc78-4274-be7f-32451e6bfadd None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:42.387230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc0f3b-fc78-4274-be7f-32451e6bfadd None admin] PATH_INFO: `/v3/users/glance` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:42.387421 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dc42c-c505-45cf-9f5c-faaff1887b1c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:42.396048 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc0f3b-fc78-4274-be7f-32451e6bfadd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:42.397499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc0f3b-fc78-4274-be7f-32451e6bfadd None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:42.411906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-f5dc0f3b-fc78-4274-be7f-32451e6bfadd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 11:56:42.411906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:42.411906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:42.411906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:42.411906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:42.411906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:42.411906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:42.411906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:42.411906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:42.411906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:42.411906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:42.411906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:42.411906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:56:42.411906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:56:42.411906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:56:42.411906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:42.412980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:42.414390 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:42.414390 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:42.414390 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:56:42.414390 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:56:42.414390 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:56:42.414390 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:56:42.414390 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:56:42.414390 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:56:42.414390 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 11:56:42.414390 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:42.414390 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 282/553] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:42.414390 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc0f3b-fc78-4274-be7f-32451e6bfadd None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:42.425252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:42.438321 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:42.491427 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dc42c-c505-45cf-9f5c-faaff1887b1c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:42.517638 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc0f3b-fc78-4274-be7f-32451e6bfadd None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:42.524459 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe8ee0-9f22-4e03-b9b5-07849308c97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:42.525114 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8ee0-9f22-4e03-b9b5-07849308c97f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:42.525396 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8ee0-9f22-4e03-b9b5-07849308c97f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:42.525669 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8ee0-9f22-4e03-b9b5-07849308c97f None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:42.527198 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe8ee0-9f22-4e03-b9b5-07849308c97f None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:42.527512 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe8ee0-9f22-4e03-b9b5-07849308c97f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:42.528904 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe8ee0-9f22-4e03-b9b5-07849308c97f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:42.536651 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 272/554] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Jul 11 11:56:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:42.537431 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe8ee0-9f22-4e03-b9b5-07849308c97f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:42.551475 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec11e92-cff4-4a9c-9103-6930a70cf1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:42.552135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec11e92-cff4-4a9c-9103-6930a70cf1b0 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:42.552417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec11e92-cff4-4a9c-9103-6930a70cf1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:42.552691 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec11e92-cff4-4a9c-9103-6930a70cf1b0 None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:42.553404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec11e92-cff4-4a9c-9103-6930a70cf1b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:42.553705 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec11e92-cff4-4a9c-9103-6930a70cf1b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:42.555118 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec11e92-cff4-4a9c-9103-6930a70cf1b0 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:42.566776 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 283/555] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:42.567575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec11e92-cff4-4a9c-9103-6930a70cf1b0 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:42.636473 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:42.639537 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe8ee0-9f22-4e03-b9b5-07849308c97f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:42.648915 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:42.671493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec11e92-cff4-4a9c-9103-6930a70cf1b0 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:42.675219 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af794e-6bc4-4c09-9eac-beeb376da08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:42.675869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af794e-6bc4-4c09-9eac-beeb376da08a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:42.676147 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af794e-6bc4-4c09-9eac-beeb376da08a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:42.676419 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af794e-6bc4-4c09-9eac-beeb376da08a None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:42.677146 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af794e-6bc4-4c09-9eac-beeb376da08a None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:42.677449 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af794e-6bc4-4c09-9eac-beeb376da08a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:42.678847 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af794e-6bc4-4c09-9eac-beeb376da08a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:42.687244 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 273/556] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Jul 11 11:56:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:42.688059 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af794e-6bc4-4c09-9eac-beeb376da08a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:42.711396 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588e923-658d-4148-8223-21677a88cdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:42.712058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588e923-658d-4148-8223-21677a88cdbc None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:42.712339 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588e923-658d-4148-8223-21677a88cdbc None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:42.712610 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588e923-658d-4148-8223-21677a88cdbc None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:42.713467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588e923-658d-4148-8223-21677a88cdbc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:42.713792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588e923-658d-4148-8223-21677a88cdbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:42.715239 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588e923-658d-4148-8223-21677a88cdbc None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:42.732031 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 284/557] 10.222.0.25 () {56 vars in 1137 bytes} [Mon Jul 11 11:56:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:42.732847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588e923-658d-4148-8223-21677a88cdbc None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:42.786155 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af794e-6bc4-4c09-9eac-beeb376da08a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:42.819573 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8f334-ef2d-47f9-8492-0282ea5d52f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:42.820351 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8f334-ef2d-47f9-8492-0282ea5d52f0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:42.820633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8f334-ef2d-47f9-8492-0282ea5d52f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:42.820909 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8f334-ef2d-47f9-8492-0282ea5d52f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:42.830666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588e923-658d-4148-8223-21677a88cdbc None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:42.832229 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8f334-ef2d-47f9-8492-0282ea5d52f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:42.833694 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8f334-ef2d-47f9-8492-0282ea5d52f0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:42.850624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-b3c8f334-ef2d-47f9-8492-0282ea5d52f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:42.850624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:42.850624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:42.850624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:42.850624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:42.850624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:42.850624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:42.850624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:42.850624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:42.850624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:42.850624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:42.850624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:42.850624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:42.850624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:42.850624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:42.851707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:42.853016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:42.853016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:42.853016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:42.853016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:42.853016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 274/558] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:42.853016 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8f334-ef2d-47f9-8492-0282ea5d52f0 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:42.856279 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:42.866925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a448c-40bc-4903-a007-63363994886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:42.867715 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a448c-40bc-4903-a007-63363994886f None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:42.867993 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a448c-40bc-4903-a007-63363994886f None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:42.868261 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a448c-40bc-4903-a007-63363994886f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:42.875611 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a448c-40bc-4903-a007-63363994886f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:42.877032 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a448c-40bc-4903-a007-63363994886f None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:42.880597 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:42.891797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-bd8a448c-40bc-4903-a007-63363994886f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:42.891797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:42.891797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:42.891797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:42.891797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:42.891797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:42.891797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:42.891797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:42.891797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:42.891797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:42.891797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:42.891797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:42.891797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:56:42.891797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:56:42.891797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:42.893158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:42.894455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:56:42.894455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:56:42.894455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:56:42.894455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:56:42.894455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:56:42.894455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:56:42.894455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:42.894455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:42.894455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 285/559] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:42.894455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a448c-40bc-4903-a007-63363994886f None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:42.956977 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8f334-ef2d-47f9-8492-0282ea5d52f0 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:42.991412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e89fe-1e53-4f59-9162-7b17c24796af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:42.992195 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e89fe-1e53-4f59-9162-7b17c24796af None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:42.992479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e89fe-1e53-4f59-9162-7b17c24796af None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:42.992750 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e89fe-1e53-4f59-9162-7b17c24796af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:42.994489 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a448c-40bc-4903-a007-63363994886f None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:43.004140 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e89fe-1e53-4f59-9162-7b17c24796af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:43.005599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e89fe-1e53-4f59-9162-7b17c24796af None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:43.023235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-955e89fe-1e53-4f59-9162-7b17c24796af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:43.023235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:43.023235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:43.023235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:43.023235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:43.023235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:43.023235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:43.023235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:43.023235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:43.023235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:43.023235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:43.023235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:43.023235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:43.023235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:43.023235 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:43.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:43.025055 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:43.025055 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:43.025055 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:43.025055 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:43.029022 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 275/560] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:43.029678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6150bd-2168-4b60-8b63-68d3c1c0da5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:43.029809 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e89fe-1e53-4f59-9162-7b17c24796af None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:43.030468 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6150bd-2168-4b60-8b63-68d3c1c0da5f None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:43.030771 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6150bd-2168-4b60-8b63-68d3c1c0da5f None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:43.031044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6150bd-2168-4b60-8b63-68d3c1c0da5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:43.043511 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6150bd-2168-4b60-8b63-68d3c1c0da5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:43.044962 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6150bd-2168-4b60-8b63-68d3c1c0da5f None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:43.062325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-3a6150bd-2168-4b60-8b63-68d3c1c0da5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:43.062325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:43.062325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:43.062325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:43.062325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:43.062325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:43.062325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:43.062325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:43.062325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:43.062325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:43.062325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:43.062325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:43.062325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:43.062325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:43.062325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:43.063439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:43.068869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:43.068869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:43.068869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:43.068869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:43.068869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 286/561] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:43.068869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6150bd-2168-4b60-8b63-68d3c1c0da5f None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:43.098043 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:43.110358 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:43.135168 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e89fe-1e53-4f59-9162-7b17c24796af None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:43.163439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6150bd-2168-4b60-8b63-68d3c1c0da5f None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:43.172876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d282549-50f3-4787-bc95-a26b8c80667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:43.173539 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d282549-50f3-4787-bc95-a26b8c80667d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:43.174130 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d282549-50f3-4787-bc95-a26b8c80667d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:43.174256 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d282549-50f3-4787-bc95-a26b8c80667d None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:43.175249 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d282549-50f3-4787-bc95-a26b8c80667d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:43.175934 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d282549-50f3-4787-bc95-a26b8c80667d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:43.176957 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d282549-50f3-4787-bc95-a26b8c80667d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:43.189650 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 276/562] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:43.190452 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d282549-50f3-4787-bc95-a26b8c80667d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:43.198419 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25317209-4e24-46d1-b5c1-448574742fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:43.199180 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25317209-4e24-46d1-b5c1-448574742fba None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:43.199458 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25317209-4e24-46d1-b5c1-448574742fba None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:43.199733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25317209-4e24-46d1-b5c1-448574742fba None admin] PATH_INFO: `/v3/projects` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:43.200515 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25317209-4e24-46d1-b5c1-448574742fba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:43.200824 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25317209-4e24-46d1-b5c1-448574742fba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:43.202248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25317209-4e24-46d1-b5c1-448574742fba None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:43.214872 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 287/563] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:56:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:43.215766 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25317209-4e24-46d1-b5c1-448574742fba None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:43.297707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d282549-50f3-4787-bc95-a26b8c80667d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:43.309349 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:43.316560 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25317209-4e24-46d1-b5c1-448574742fba None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:43.333095 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fb687-0697-46cc-83ec-92065b3573a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:43.333754 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fb687-0697-46cc-83ec-92065b3573a0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:43.334037 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fb687-0697-46cc-83ec-92065b3573a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:43.334313 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fb687-0697-46cc-83ec-92065b3573a0 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:43.335079 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fb687-0697-46cc-83ec-92065b3573a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:43.335407 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fb687-0697-46cc-83ec-92065b3573a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:43.336791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fb687-0697-46cc-83ec-92065b3573a0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:43.338224 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:43.350280 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 277/564] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:43.351133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fb687-0697-46cc-83ec-92065b3573a0 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:43.357171 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e160c2-976e-4afe-9d46-cedec46de8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:43.357838 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e160c2-976e-4afe-9d46-cedec46de8ef None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:43.358122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e160c2-976e-4afe-9d46-cedec46de8ef None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:43.358399 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e160c2-976e-4afe-9d46-cedec46de8ef None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:43.359141 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e160c2-976e-4afe-9d46-cedec46de8ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:43.359452 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e160c2-976e-4afe-9d46-cedec46de8ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:43.360822 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e160c2-976e-4afe-9d46-cedec46de8ef None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:43.372725 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 288/565] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:43.373562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e160c2-976e-4afe-9d46-cedec46de8ef None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:43.453856 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fb687-0697-46cc-83ec-92065b3573a0 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:43.476604 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e160c2-976e-4afe-9d46-cedec46de8ef None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:43.487412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985617c5-dd89-4ec8-818c-b24bb3af9934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:43.488190 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985617c5-dd89-4ec8-818c-b24bb3af9934 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:43.488466 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985617c5-dd89-4ec8-818c-b24bb3af9934 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:43.488736 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985617c5-dd89-4ec8-818c-b24bb3af9934 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:43.496225 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985617c5-dd89-4ec8-818c-b24bb3af9934 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:43.497661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985617c5-dd89-4ec8-818c-b24bb3af9934 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:43.511036 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc65f8e-d95e-4c63-ac90-2d8914f59e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:43.511661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-985617c5-dd89-4ec8-818c-b24bb3af9934 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 11:56:43.511661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:43.511661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:43.511661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:43.511661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:43.511661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:43.511661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:43.511661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:43.511661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:43.511661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:43.511661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:43.511661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:43.511661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:56:43.511661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:56:43.511661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:56:43.511661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:43.512649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:43.513579 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:43.513579 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:43.513579 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:56:43.513579 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:56:43.513579 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:56:43.513579 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:56:43.513579 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:56:43.513579 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:56:43.513579 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 11:56:43.513579 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:43.514106 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc65f8e-d95e-4c63-ac90-2d8914f59e6d None admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:43.514106 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc65f8e-d95e-4c63-ac90-2d8914f59e6d None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:43.514106 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc65f8e-d95e-4c63-ac90-2d8914f59e6d None admin] PATH_INFO: `/v3/projects/6e452080fec045788d9bd5dfdb7a3c52/users/11550a0ca11041b0b9b175860f2b6633/roles/22d318004ece47b3a0d4d3919bfebdc9` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:43.514293 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 278/566] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:43.514293 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985617c5-dd89-4ec8-818c-b24bb3af9934 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:43.530807 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc65f8e-d95e-4c63-ac90-2d8914f59e6d None admin] RBAC: Authorizing `identity:create_grant(project_id=6e452080fec045788d9bd5dfdb7a3c52, user_id=11550a0ca11041b0b9b175860f2b6633, role_id=22d318004ece47b3a0d4d3919bfebdc9)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:43.532241 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc65f8e-d95e-4c63-ac90-2d8914f59e6d None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:43.545151 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 289/567] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Jul 11 11:56:43 2022] PUT /identity/v3/projects/6e452080fec045788d9bd5dfdb7a3c52/users/11550a0ca11041b0b9b175860f2b6633/roles/22d318004ece47b3a0d4d3919bfebdc9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:56:43.545959 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc65f8e-d95e-4c63-ac90-2d8914f59e6d None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:43.569580 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:43.581244 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:43.637854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985617c5-dd89-4ec8-818c-b24bb3af9934 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:43.676519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0a88a-584b-4407-aa36-62879f6ee68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:43.677337 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0a88a-584b-4407-aa36-62879f6ee68e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:43.677625 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0a88a-584b-4407-aa36-62879f6ee68e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:43.677901 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0a88a-584b-4407-aa36-62879f6ee68e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:43.681657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc65f8e-d95e-4c63-ac90-2d8914f59e6d None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:43.687166 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0a88a-584b-4407-aa36-62879f6ee68e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:43.688678 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0a88a-584b-4407-aa36-62879f6ee68e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:43.704265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-34d0a88a-584b-4407-aa36-62879f6ee68e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 11:56:43.704265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:43.704265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:43.704265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:43.704265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:43.704265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:43.704265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:43.704265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:43.704265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:43.704265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:43.704265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:43.704265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:43.704265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:56:43.704265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:56:43.704265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:56:43.704265 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:43.705442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:43.706588 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:43.706588 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:43.706588 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:56:43.706588 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:56:43.706588 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:56:43.706588 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:56:43.706588 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:56:43.706588 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:56:43.706588 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 11:56:43.706588 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:43.710138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 279/568] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:56:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:43.711103 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0a88a-584b-4407-aa36-62879f6ee68e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:43.725695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b71f9-422f-4761-b756-a4eb73a30ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:43.726597 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b71f9-422f-4761-b756-a4eb73a30ba9 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:43.726920 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b71f9-422f-4761-b756-a4eb73a30ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:43.727206 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b71f9-422f-4761-b756-a4eb73a30ba9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:43.734756 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b71f9-422f-4761-b756-a4eb73a30ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:43.736250 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b71f9-422f-4761-b756-a4eb73a30ba9 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:43.751551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-757b71f9-422f-4761-b756-a4eb73a30ba9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:43.751551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:43.751551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:43.751551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:43.751551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:43.751551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:43.751551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:43.751551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:43.751551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:43.751551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:43.751551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:43.751551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:43.751551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:56:43.751551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:56:43.751551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:43.752471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:43.753349 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:56:43.753349 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:56:43.753349 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:56:43.753349 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:56:43.753349 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:56:43.753349 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:56:43.753349 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:43.753349 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:43.753349 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 290/569] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:43.753844 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b71f9-422f-4761-b756-a4eb73a30ba9 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:43.827993 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:43.835327 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0a88a-584b-4407-aa36-62879f6ee68e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:43.852900 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:43.866960 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b71f9-422f-4761-b756-a4eb73a30ba9 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:43.881344 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf86f21-e427-49d7-b781-febc077b799c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:43.882013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf86f21-e427-49d7-b781-febc077b799c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:43.882295 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf86f21-e427-49d7-b781-febc077b799c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:43.882573 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf86f21-e427-49d7-b781-febc077b799c None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:43.883443 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf86f21-e427-49d7-b781-febc077b799c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:43.883757 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf86f21-e427-49d7-b781-febc077b799c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:43.885335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf86f21-e427-49d7-b781-febc077b799c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:43.904537 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 280/570] 10.222.0.25 () {56 vars in 1137 bytes} [Mon Jul 11 11:56:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:43.906070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf86f21-e427-49d7-b781-febc077b799c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:43.908302 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b653e-c6eb-4b34-b923-0c8035b468ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:43.909073 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b653e-c6eb-4b34-b923-0c8035b468ca None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:43.909419 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b653e-c6eb-4b34-b923-0c8035b468ca None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:43.909690 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b653e-c6eb-4b34-b923-0c8035b468ca None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:43.910646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b653e-c6eb-4b34-b923-0c8035b468ca None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:43.910987 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b653e-c6eb-4b34-b923-0c8035b468ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:43.912424 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b653e-c6eb-4b34-b923-0c8035b468ca None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:43.938187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 291/571] 10.222.0.25 () {56 vars in 1139 bytes} [Mon Jul 11 11:56:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:43.938187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b653e-c6eb-4b34-b923-0c8035b468ca None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:44.027370 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf86f21-e427-49d7-b781-febc077b799c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:44.043353 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b653e-c6eb-4b34-b923-0c8035b468ca None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:44.063551 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdfb13-ad89-4700-9213-9cee3fac5e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:44.064215 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdfb13-ad89-4700-9213-9cee3fac5e9d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:44.064504 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdfb13-ad89-4700-9213-9cee3fac5e9d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:44.064789 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdfb13-ad89-4700-9213-9cee3fac5e9d None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:44.065570 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdfb13-ad89-4700-9213-9cee3fac5e9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:44.065884 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdfb13-ad89-4700-9213-9cee3fac5e9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:44.067120 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:44.067364 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdfb13-ad89-4700-9213-9cee3fac5e9d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:44.080036 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 281/572] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:56:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:44.080852 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdfb13-ad89-4700-9213-9cee3fac5e9d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:44.085611 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23749ea3-1429-4c97-a4b6-9497926a8f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:44.086407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23749ea3-1429-4c97-a4b6-9497926a8f19 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:44.086689 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23749ea3-1429-4c97-a4b6-9497926a8f19 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:44.086989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23749ea3-1429-4c97-a4b6-9497926a8f19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:44.098238 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23749ea3-1429-4c97-a4b6-9497926a8f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:44.099718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23749ea3-1429-4c97-a4b6-9497926a8f19 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:44.117342 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:44.117798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-23749ea3-1429-4c97-a4b6-9497926a8f19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:44.117798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:44.117798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:44.117798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:44.117798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:44.117798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:44.117798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:44.117798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:44.117798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:44.117798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:44.117798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:44.117798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:44.117798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:44.117798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:44.117798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:44.118642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:44.119556 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:44.119556 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:44.119556 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:44.119556 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:44.119556 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 292/573] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:44.120598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23749ea3-1429-4c97-a4b6-9497926a8f19 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:44.205149 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdfb13-ad89-4700-9213-9cee3fac5e9d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:44.228814 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23749ea3-1429-4c97-a4b6-9497926a8f19 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:44.249395 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f0df2-8270-4220-92b6-df1a079cf66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:44.250184 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f0df2-8270-4220-92b6-df1a079cf66a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:44.250466 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f0df2-8270-4220-92b6-df1a079cf66a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:44.250764 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f0df2-8270-4220-92b6-df1a079cf66a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:44.263763 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f0df2-8270-4220-92b6-df1a079cf66a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:44.265219 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f0df2-8270-4220-92b6-df1a079cf66a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:44.265521 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead876e-260c-4792-aa3b-620824efea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:44.266595 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead876e-260c-4792-aa3b-620824efea57 None admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:44.266904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead876e-260c-4792-aa3b-620824efea57 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:44.267293 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead876e-260c-4792-aa3b-620824efea57 None admin] PATH_INFO: `/v3/projects/6e452080fec045788d9bd5dfdb7a3c52/users/dce9ec24be9049bfacddcf3c068f2f65/roles/22d318004ece47b3a0d4d3919bfebdc9` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:44.283572 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead876e-260c-4792-aa3b-620824efea57 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e452080fec045788d9bd5dfdb7a3c52, user_id=dce9ec24be9049bfacddcf3c068f2f65, role_id=22d318004ece47b3a0d4d3919bfebdc9)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:44.284944 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead876e-260c-4792-aa3b-620824efea57 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:44.286762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-fa1f0df2-8270-4220-92b6-df1a079cf66a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:44.286762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:44.286762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:44.286762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:44.286762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:44.286762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:44.286762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:44.286762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:44.286762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:44.286762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:44.286762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:44.286762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:44.286762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:44.286762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:44.286762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:44.287621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:44.288509 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:44.288509 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:44.288509 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:44.288509 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:44.292990 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 282/574] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:44.293939 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f0df2-8270-4220-92b6-df1a079cf66a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:44.310961 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 293/575] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Jul 11 11:56:44 2022] PUT /identity/v3/projects/6e452080fec045788d9bd5dfdb7a3c52/users/dce9ec24be9049bfacddcf3c068f2f65/roles/22d318004ece47b3a0d4d3919bfebdc9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:56:44.310961 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead876e-260c-4792-aa3b-620824efea57 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:44.342642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:44.412827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:44.431543 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f0df2-8270-4220-92b6-df1a079cf66a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:44.456044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead876e-260c-4792-aa3b-620824efea57 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:44.472228 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360d509-22da-46fe-8e42-f21409d2a205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:44.476448 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360d509-22da-46fe-8e42-f21409d2a205 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:44.476448 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360d509-22da-46fe-8e42-f21409d2a205 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:44.476448 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360d509-22da-46fe-8e42-f21409d2a205 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:44.476448 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360d509-22da-46fe-8e42-f21409d2a205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:44.476448 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360d509-22da-46fe-8e42-f21409d2a205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:44.476448 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360d509-22da-46fe-8e42-f21409d2a205 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:44.495845 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 283/576] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:44.496909 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360d509-22da-46fe-8e42-f21409d2a205 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:44.499429 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e072e-0c8a-4fe9-b143-aa79c263a2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:44.500112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e072e-0c8a-4fe9-b143-aa79c263a2be None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:44.500400 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e072e-0c8a-4fe9-b143-aa79c263a2be None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:44.500743 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e072e-0c8a-4fe9-b143-aa79c263a2be None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:44.502047 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e072e-0c8a-4fe9-b143-aa79c263a2be None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:44.503594 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e072e-0c8a-4fe9-b143-aa79c263a2be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:44.503774 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e072e-0c8a-4fe9-b143-aa79c263a2be None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:44.517220 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 294/577] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:44.522776 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e072e-0c8a-4fe9-b143-aa79c263a2be None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:44.607223 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360d509-22da-46fe-8e42-f21409d2a205 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:44.628027 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e072e-0c8a-4fe9-b143-aa79c263a2be None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:44.631049 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:44.644387 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe782e-a062-4922-aacf-d5cd3daecd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:44.645103 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe782e-a062-4922-aacf-d5cd3daecd57 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:44.645387 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe782e-a062-4922-aacf-d5cd3daecd57 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:44.645665 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe782e-a062-4922-aacf-d5cd3daecd57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:44.654089 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe782e-a062-4922-aacf-d5cd3daecd57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:44.655692 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe782e-a062-4922-aacf-d5cd3daecd57 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:44.666961 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01287d22-16f2-48af-ba82-ce0cb31acf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:44.667671 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01287d22-16f2-48af-ba82-ce0cb31acf10 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:44.667965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01287d22-16f2-48af-ba82-ce0cb31acf10 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:44.668248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01287d22-16f2-48af-ba82-ce0cb31acf10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:44.670577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-75fe782e-a062-4922-aacf-d5cd3daecd57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:44.670577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:44.670577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:44.670577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:44.670577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:44.670577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:44.670577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:44.670577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:44.670577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:44.670577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:44.670577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:44.670577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:44.670577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:56:44.670577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:56:44.670577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:44.672507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:44.674640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:56:44.674640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:56:44.674640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:56:44.674640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:56:44.674640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:56:44.674640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:56:44.674640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:44.674640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:44.674640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 284/578] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:44.682917 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01287d22-16f2-48af-ba82-ce0cb31acf10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:44.682917 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01287d22-16f2-48af-ba82-ce0cb31acf10 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:44.683198 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe782e-a062-4922-aacf-d5cd3daecd57 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:44.683198 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:44.694319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-01287d22-16f2-48af-ba82-ce0cb31acf10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:44.694319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:44.694319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:44.694319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:44.694319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:44.694319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:44.694319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:44.694319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:44.694319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:44.694319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:44.694319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:44.694319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:44.694319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:56:44.694319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:56:44.694319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:44.695497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:44.696672 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:56:44.696672 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:56:44.696672 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:56:44.696672 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:56:44.696672 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:56:44.696672 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:56:44.696672 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:44.696672 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:44.698984 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 295/579] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:44.705129 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01287d22-16f2-48af-ba82-ce0cb31acf10 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:44.788586 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe782e-a062-4922-aacf-d5cd3daecd57 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:44.824254 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01287d22-16f2-48af-ba82-ce0cb31acf10 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:44.824785 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e065df-a0cc-4f6e-8127-8d9a0709b579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:44.825347 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e065df-a0cc-4f6e-8127-8d9a0709b579 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:44.825632 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e065df-a0cc-4f6e-8127-8d9a0709b579 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:44.825907 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e065df-a0cc-4f6e-8127-8d9a0709b579 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:44.826695 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e065df-a0cc-4f6e-8127-8d9a0709b579 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:44.827051 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e065df-a0cc-4f6e-8127-8d9a0709b579 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:44.829519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e065df-a0cc-4f6e-8127-8d9a0709b579 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:44.845187 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 285/580] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:56:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:44.850752 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e065df-a0cc-4f6e-8127-8d9a0709b579 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:44.866120 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e505eb5-7188-4b75-9e48-afaf0d170ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:44.866917 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e505eb5-7188-4b75-9e48-afaf0d170ba5 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:44.867294 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e505eb5-7188-4b75-9e48-afaf0d170ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:44.867699 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e505eb5-7188-4b75-9e48-afaf0d170ba5 None admin] PATH_INFO: `/v3/projects` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:44.868624 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e505eb5-7188-4b75-9e48-afaf0d170ba5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:44.869025 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e505eb5-7188-4b75-9e48-afaf0d170ba5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:44.870944 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e505eb5-7188-4b75-9e48-afaf0d170ba5 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:44.885950 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 296/581] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:56:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:44.891564 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e505eb5-7188-4b75-9e48-afaf0d170ba5 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:44.900551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:44.934834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:44.986759 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e065df-a0cc-4f6e-8127-8d9a0709b579 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:45.002642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e505eb5-7188-4b75-9e48-afaf0d170ba5 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:45.027355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c54f5-a3a9-4738-af25-72dc728a0377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:45.028382 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c54f5-a3a9-4738-af25-72dc728a0377 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:45.028842 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c54f5-a3a9-4738-af25-72dc728a0377 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:45.029287 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c54f5-a3a9-4738-af25-72dc728a0377 None admin] PATH_INFO: `/v3/projects/6e452080fec045788d9bd5dfdb7a3c52/users/009ac389925143f1954c5d1971155318/roles/22d318004ece47b3a0d4d3919bfebdc9` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:45.046650 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c54f5-a3a9-4738-af25-72dc728a0377 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e452080fec045788d9bd5dfdb7a3c52, user_id=009ac389925143f1954c5d1971155318, role_id=22d318004ece47b3a0d4d3919bfebdc9)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:45.047161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739fa2a-cdd5-4ac1-8a24-d7b947095b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:45.048060 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739fa2a-cdd5-4ac1-8a24-d7b947095b63 None admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:45.048343 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739fa2a-cdd5-4ac1-8a24-d7b947095b63 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:45.048543 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c54f5-a3a9-4738-af25-72dc728a0377 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:45.048652 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739fa2a-cdd5-4ac1-8a24-d7b947095b63 None admin] PATH_INFO: `/v3/projects/6e452080fec045788d9bd5dfdb7a3c52/users/2b005858b98e4e27b2536d9ea3908f09/roles/22d318004ece47b3a0d4d3919bfebdc9` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:45.065154 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739fa2a-cdd5-4ac1-8a24-d7b947095b63 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e452080fec045788d9bd5dfdb7a3c52, user_id=2b005858b98e4e27b2536d9ea3908f09, role_id=22d318004ece47b3a0d4d3919bfebdc9)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:45.066737 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739fa2a-cdd5-4ac1-8a24-d7b947095b63 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:45.068810 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 286/582] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Jul 11 11:56:44 2022] PUT /identity/v3/projects/6e452080fec045788d9bd5dfdb7a3c52/users/009ac389925143f1954c5d1971155318/roles/22d318004ece47b3a0d4d3919bfebdc9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 11:56:45.095135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 297/583] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Jul 11 11:56:44 2022] PUT /identity/v3/projects/6e452080fec045788d9bd5dfdb7a3c52/users/2b005858b98e4e27b2536d9ea3908f09/roles/22d318004ece47b3a0d4d3919bfebdc9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:56:45.878197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892b391-730c-49d8-bc52-de4e7b900019 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:45.878759 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892b391-730c-49d8-bc52-de4e7b900019 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:45.878852 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892b391-730c-49d8-bc52-de4e7b900019 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:45.880455 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 287/584] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:45.885882 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4c8c5-54e8-4d8e-95a0-5dde4d49828c None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:45.886539 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4c8c5-54e8-4d8e-95a0-5dde4d49828c None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:45.886539 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4c8c5-54e8-4d8e-95a0-5dde4d49828c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:45.905750 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-55a4c8c5-54e8-4d8e-95a0-5dde4d49828c None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:45.906968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-55a4c8c5-54e8-4d8e-95a0-5dde4d49828c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:45.962315 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:45.986884 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 298/585] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:46.007303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892b391-730c-49d8-bc52-de4e7b900019 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:46.111088 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892b391-730c-49d8-bc52-de4e7b900019 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:46.125531 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:46.147203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082c441-2335-4026-9b68-fbde19832da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:46.147927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082c441-2335-4026-9b68-fbde19832da7 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:46.148214 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082c441-2335-4026-9b68-fbde19832da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:46.148491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082c441-2335-4026-9b68-fbde19832da7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:46.159856 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082c441-2335-4026-9b68-fbde19832da7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:46.168104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-c082c441-2335-4026-9b68-fbde19832da7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:46.168104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:46.168104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:46.168104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:46.168104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:46.168104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:46.168104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:46.168104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:46.168104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:46.168104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:46.168104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:46.168104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:46.168104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:46.168104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:46.168104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:46.168104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:46.169072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:46.169072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:46.169072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:46.169072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:46.169072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:46.169072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:46.169072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:46.169072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:46.169072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:46.169072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:46.169072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:46.169072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:46.169072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:46.169072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:46.169072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:46.169072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:46.169898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:46.169898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:46.169898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:46.169898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:46.169898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:46.169898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:46.169898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:46.169898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:46.169898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:46.169898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:46.169898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:46.169898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:46.169898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 288/586] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:56:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:46.175372 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4c8c5-54e8-4d8e-95a0-5dde4d49828c None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:46.279730 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4c8c5-54e8-4d8e-95a0-5dde4d49828c None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:46.317316 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864af582-ce9c-4334-8ca0-79a849cb3f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:46.317995 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864af582-ce9c-4334-8ca0-79a849cb3f97 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:46.318283 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864af582-ce9c-4334-8ca0-79a849cb3f97 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:46.318564 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864af582-ce9c-4334-8ca0-79a849cb3f97 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:46.319346 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864af582-ce9c-4334-8ca0-79a849cb3f97 None admin] RBAC: Adding query filter params (name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:46.319656 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864af582-ce9c-4334-8ca0-79a849cb3f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:46.321037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864af582-ce9c-4334-8ca0-79a849cb3f97 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:46.334848 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 299/587] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Jul 11 11:56:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:46.336482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082c441-2335-4026-9b68-fbde19832da7 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:46.447239 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082c441-2335-4026-9b68-fbde19832da7 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:46.482983 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663a97e-3f77-4e8e-a07f-64c6b87ccbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:46.483778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663a97e-3f77-4e8e-a07f-64c6b87ccbde None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:46.484054 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663a97e-3f77-4e8e-a07f-64c6b87ccbde None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:46.484325 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663a97e-3f77-4e8e-a07f-64c6b87ccbde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:46.495807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663a97e-3f77-4e8e-a07f-64c6b87ccbde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:46.497254 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663a97e-3f77-4e8e-a07f-64c6b87ccbde None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:46.519943 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-5663a97e-3f77-4e8e-a07f-64c6b87ccbde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:46.519943 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:46.519943 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:46.519943 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:46.519943 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:46.519943 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:46.519943 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:46.519943 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:46.519943 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:46.519943 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:46.519943 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:46.519943 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:46.519943 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:46.519943 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:46.519943 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:46.520876 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:46.521738 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:46.521738 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:46.521738 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:46.521738 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:46.525981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 289/588] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:46.527526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864af582-ce9c-4334-8ca0-79a849cb3f97 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:46.595066 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:46.635835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864af582-ce9c-4334-8ca0-79a849cb3f97 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:46.669561 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fa3e8-e65b-4503-8ddf-6a037a9df441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:46.670223 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fa3e8-e65b-4503-8ddf-6a037a9df441 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:46.670505 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fa3e8-e65b-4503-8ddf-6a037a9df441 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:46.670807 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fa3e8-e65b-4503-8ddf-6a037a9df441 None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:46.671524 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fa3e8-e65b-4503-8ddf-6a037a9df441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:46.671827 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fa3e8-e65b-4503-8ddf-6a037a9df441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:46.673189 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fa3e8-e65b-4503-8ddf-6a037a9df441 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:46.689062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 300/589] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:46.692615 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcf049-9a44-493f-af13-445b2daaf28a None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:46.692902 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcf049-9a44-493f-af13-445b2daaf28a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:46.693174 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcf049-9a44-493f-af13-445b2daaf28a None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:46.694678 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 290/590] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:46.695457 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fa3e8-e65b-4503-8ddf-6a037a9df441 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:46.701931 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e5e33-95c1-44c6-8de0-08d98a4c73ce None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:46.702156 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e5e33-95c1-44c6-8de0-08d98a4c73ce None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:46.702420 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e5e33-95c1-44c6-8de0-08d98a4c73ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:46.722641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-f96e5e33-95c1-44c6-8de0-08d98a4c73ce None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:46.724341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f96e5e33-95c1-44c6-8de0-08d98a4c73ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:46.751306 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:46.813708 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 291/591] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:46.814185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fa3e8-e65b-4503-8ddf-6a037a9df441 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:46.827755 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:46.839102 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e5e33-95c1-44c6-8de0-08d98a4c73ce None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:46.857436 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1707545-491e-4e13-bb98-5da06aa79fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:46.858225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1707545-491e-4e13-bb98-5da06aa79fac None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:46.858507 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1707545-491e-4e13-bb98-5da06aa79fac None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:46.858818 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1707545-491e-4e13-bb98-5da06aa79fac None admin] PATH_INFO: `/v3/users/nova` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:46.867606 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1707545-491e-4e13-bb98-5da06aa79fac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:46.869873 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1707545-491e-4e13-bb98-5da06aa79fac None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:46.893195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-c1707545-491e-4e13-bb98-5da06aa79fac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:56:46.893195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:46.893195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:46.893195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:46.893195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:46.893195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:46.893195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:46.893195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:46.893195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:46.893195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:46.893195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:46.893195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:46.893195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:56:46.893195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:56:46.893195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:56:46.893195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:46.894626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:46.895991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:46.895991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:46.895991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:56:46.895991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:56:46.895991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:56:46.895991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:56:46.895991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:56:46.895991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:56:46.895991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:56:46.895991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:46.895991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 301/592] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Jul 11 11:56:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:46.902388 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1707545-491e-4e13-bb98-5da06aa79fac None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:46.958127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e5e33-95c1-44c6-8de0-08d98a4c73ce None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:46.997020 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001cba5-ada2-4a5f-98fd-68736af43080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:46.998247 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001cba5-ada2-4a5f-98fd-68736af43080 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:46.998775 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001cba5-ada2-4a5f-98fd-68736af43080 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:46.999213 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001cba5-ada2-4a5f-98fd-68736af43080 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:47.007368 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1707545-491e-4e13-bb98-5da06aa79fac None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:47.011067 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001cba5-ada2-4a5f-98fd-68736af43080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:47.019116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-3001cba5-ada2-4a5f-98fd-68736af43080 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:47.019116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:47.019116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:47.019116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:47.019116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:47.019116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:47.019116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:47.019116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:47.019116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:47.019116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:47.019116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:47.019116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:47.019116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:47.019116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:47.019116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:47.019116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:47.020034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:47.020034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:47.020034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:47.020034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:47.020034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:47.020034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:47.020034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:47.020034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:47.020034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:47.020034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:47.020034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:47.020034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:47.020034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:47.020034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:47.020034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:47.020034 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:47.020853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:47.020853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:47.020853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:47.020853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:47.020853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:47.020853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:47.020853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:47.020853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:47.020853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:47.020853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:47.020853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:47.020853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:47.023700 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 292/593] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:56:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:47.029290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001cba5-ada2-4a5f-98fd-68736af43080 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:47.044058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a18278-48aa-4928-b5c7-522bef382830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:47.045080 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a18278-48aa-4928-b5c7-522bef382830 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:47.045561 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a18278-48aa-4928-b5c7-522bef382830 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:47.046030 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a18278-48aa-4928-b5c7-522bef382830 None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:47.047158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a18278-48aa-4928-b5c7-522bef382830 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:47.047667 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a18278-48aa-4928-b5c7-522bef382830 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:47.049297 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a18278-48aa-4928-b5c7-522bef382830 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:47.053269 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:47.069515 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 302/594] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Jul 11 11:56:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:47.075608 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a18278-48aa-4928-b5c7-522bef382830 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:47.110403 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:47.152023 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001cba5-ada2-4a5f-98fd-68736af43080 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:47.188636 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaabdf-0a45-4452-aec9-645e971bfbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:47.189329 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaabdf-0a45-4452-aec9-645e971bfbce None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:47.189609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaabdf-0a45-4452-aec9-645e971bfbce None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:47.189880 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaabdf-0a45-4452-aec9-645e971bfbce None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:47.190614 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eaabdf-0a45-4452-aec9-645e971bfbce None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:47.190990 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eaabdf-0a45-4452-aec9-645e971bfbce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:47.192125 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a18278-48aa-4928-b5c7-522bef382830 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:47.192416 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eaabdf-0a45-4452-aec9-645e971bfbce None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:47.201266 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 293/595] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Jul 11 11:56:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:47.206184 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaabdf-0a45-4452-aec9-645e971bfbce None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:47.234364 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd2c89-de39-4dfe-a23c-3462a9d21230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:47.235576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd2c89-de39-4dfe-a23c-3462a9d21230 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:47.236054 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd2c89-de39-4dfe-a23c-3462a9d21230 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:47.236499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd2c89-de39-4dfe-a23c-3462a9d21230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:47.299900 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:47.330444 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd2c89-de39-4dfe-a23c-3462a9d21230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:47.332067 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaabdf-0a45-4452-aec9-645e971bfbce None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:47.332451 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd2c89-de39-4dfe-a23c-3462a9d21230 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:47.363887 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:47.384313 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3beff-c97e-43db-9c69-c65d9607d8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:47.385765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3beff-c97e-43db-9c69-c65d9607d8bd None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:47.386122 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3beff-c97e-43db-9c69-c65d9607d8bd None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:47.386459 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3beff-c97e-43db-9c69-c65d9607d8bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:47.402251 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3beff-c97e-43db-9c69-c65d9607d8bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:47.404491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3beff-c97e-43db-9c69-c65d9607d8bd None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:47.428792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-4bb3beff-c97e-43db-9c69-c65d9607d8bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:47.428792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:47.428792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:47.428792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:47.428792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:47.428792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:47.428792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:47.428792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:47.428792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:47.428792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:47.428792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:47.428792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:47.428792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:47.428792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:47.428792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:47.429911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:47.431199 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:47.431199 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:47.431199 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:47.431199 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:47.431689 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 294/596] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:47.437029 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3beff-c97e-43db-9c69-c65d9607d8bd None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:47.461669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 303/597] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 11:56:47.464035 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd2c89-de39-4dfe-a23c-3462a9d21230 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:47.556762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3beff-c97e-43db-9c69-c65d9607d8bd None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:47.569798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd2c89-de39-4dfe-a23c-3462a9d21230 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:47.584823 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:47.591199 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75a1c9-43fb-4572-acce-79ef1d5a6b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:47.591857 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75a1c9-43fb-4572-acce-79ef1d5a6b90 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:47.592140 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75a1c9-43fb-4572-acce-79ef1d5a6b90 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:47.592414 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75a1c9-43fb-4572-acce-79ef1d5a6b90 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:47.593122 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75a1c9-43fb-4572-acce-79ef1d5a6b90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:47.593425 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75a1c9-43fb-4572-acce-79ef1d5a6b90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:47.594823 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75a1c9-43fb-4572-acce-79ef1d5a6b90 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:47.596013 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:47.604762 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0a81a-4db7-4474-a685-794b16b510de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:47.605545 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0a81a-4db7-4474-a685-794b16b510de None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:47.605828 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0a81a-4db7-4474-a685-794b16b510de None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:47.606102 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0a81a-4db7-4474-a685-794b16b510de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:47.607254 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 295/598] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:47.608734 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed591fee-8d21-4219-b3ac-314bb6433b4d None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:47.609020 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed591fee-8d21-4219-b3ac-314bb6433b4d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:47.609294 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed591fee-8d21-4219-b3ac-314bb6433b4d None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:47.614615 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 296/599] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:47.615542 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd07bb-abd5-4a50-bdd5-b24cfd02fa53 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:47.615880 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd07bb-abd5-4a50-bdd5-b24cfd02fa53 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:47.616123 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd07bb-abd5-4a50-bdd5-b24cfd02fa53 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:47.616456 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0a81a-4db7-4474-a685-794b16b510de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:47.617504 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 297/600] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:47.617895 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0a81a-4db7-4474-a685-794b16b510de None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:47.618033 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd07bb-abd5-4a50-bdd5-b24cfd02fa53 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:47.636847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-d3c0a81a-4db7-4474-a685-794b16b510de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:47.636847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:47.636847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:47.636847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:47.636847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:47.636847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:47.636847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:47.636847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:47.636847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:47.636847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:47.636847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:47.636847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:47.636847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:47.636847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:47.636847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:47.637874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:47.638748 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:47.638748 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:47.638748 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:47.638748 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:47.638748 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 304/601] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:47.639254 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8df28-079b-4fbf-8b69-9c97ef20d9df None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:47.639533 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8df28-079b-4fbf-8b69-9c97ef20d9df None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:47.639807 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8df28-079b-4fbf-8b69-9c97ef20d9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:47.656563 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-54a8df28-079b-4fbf-8b69-9c97ef20d9df None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:47.657751 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-54a8df28-079b-4fbf-8b69-9c97ef20d9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:47.723711 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 305/602] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:47.725032 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd07bb-abd5-4a50-bdd5-b24cfd02fa53 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:47.725162 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072314eb-9395-484a-b352-97ae6550b982 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:47.725475 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072314eb-9395-484a-b352-97ae6550b982 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:47.725758 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072314eb-9395-484a-b352-97ae6550b982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:47.750938 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-072314eb-9395-484a-b352-97ae6550b982 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:47.752136 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-072314eb-9395-484a-b352-97ae6550b982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:47.760057 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38e619-6750-43a7-a73c-f584db70666c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:47.760946 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38e619-6750-43a7-a73c-f584db70666c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:47.761238 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38e619-6750-43a7-a73c-f584db70666c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:47.761506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38e619-6750-43a7-a73c-f584db70666c None admin] PATH_INFO: `/v3/users/glance` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:47.768621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38e619-6750-43a7-a73c-f584db70666c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:47.770063 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38e619-6750-43a7-a73c-f584db70666c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:47.784350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-9a38e619-6750-43a7-a73c-f584db70666c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 11:56:47.784350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:47.784350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:47.784350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:47.784350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:47.784350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:47.784350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:47.784350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:47.784350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:47.784350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:47.784350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:47.784350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:47.784350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:56:47.784350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:56:47.784350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:56:47.784350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:47.785262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:47.786183 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:47.786183 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:47.786183 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:56:47.786183 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:56:47.786183 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:56:47.786183 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:56:47.786183 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:56:47.786183 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:56:47.786183 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 11:56:47.786183 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:47.786183 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 298/603] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:47.786788 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38e619-6750-43a7-a73c-f584db70666c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:47.825590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 306/604] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:47.826369 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072314eb-9395-484a-b352-97ae6550b982 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:47.838280 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:47.866091 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:47.891715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38e619-6750-43a7-a73c-f584db70666c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:47.925625 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3297f3-576d-4168-b95d-cdc2288cea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:47.926281 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3297f3-576d-4168-b95d-cdc2288cea40 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:47.926571 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3297f3-576d-4168-b95d-cdc2288cea40 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:47.926874 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3297f3-576d-4168-b95d-cdc2288cea40 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:47.927578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3297f3-576d-4168-b95d-cdc2288cea40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:47.927878 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3297f3-576d-4168-b95d-cdc2288cea40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:47.929243 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3297f3-576d-4168-b95d-cdc2288cea40 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:47.932188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072314eb-9395-484a-b352-97ae6550b982 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:47.940507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 299/605] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:47.941353 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3297f3-576d-4168-b95d-cdc2288cea40 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:47.968570 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72d73d-28da-4ca3-9d04-e9e688262ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:47.969360 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72d73d-28da-4ca3-9d04-e9e688262ffd None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:47.969642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72d73d-28da-4ca3-9d04-e9e688262ffd None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:47.969911 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72d73d-28da-4ca3-9d04-e9e688262ffd None admin] PATH_INFO: `/v3/roles/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:47.981452 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72d73d-28da-4ca3-9d04-e9e688262ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:47.989122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-dc72d73d-28da-4ca3-9d04-e9e688262ffd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:47.989122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:47.989122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:47.989122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:47.989122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:47.989122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:47.989122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:47.989122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:47.989122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:47.989122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:47.989122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:47.989122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:47.989122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:47.989122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:47.989122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:47.989122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:47.990221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:47.990221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:47.990221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:47.990221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:47.990221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:47.990221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:47.990221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:47.990221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:47.990221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:47.990221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:47.990221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:47.990221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:47.990221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:47.990221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:47.990221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:47.990221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:47.991289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:47.991289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:47.991289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:47.991289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:47.991289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:47.991289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:47.991289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:47.991289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:47.991289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:47.991289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:47.991289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:47.991289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:47.991289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 307/606] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:56:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:47.991289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72d73d-28da-4ca3-9d04-e9e688262ffd None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:48.045312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3297f3-576d-4168-b95d-cdc2288cea40 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:48.055844 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:48.079329 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a35b9f-fdb1-4c7d-b6d6-8a8d1d1c3da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:48.079918 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a35b9f-fdb1-4c7d-b6d6-8a8d1d1c3da5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:48.080201 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a35b9f-fdb1-4c7d-b6d6-8a8d1d1c3da5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:48.080477 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a35b9f-fdb1-4c7d-b6d6-8a8d1d1c3da5 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:48.081297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a35b9f-fdb1-4c7d-b6d6-8a8d1d1c3da5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:48.081606 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a35b9f-fdb1-4c7d-b6d6-8a8d1d1c3da5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:48.083101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a35b9f-fdb1-4c7d-b6d6-8a8d1d1c3da5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:48.085384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:48.089885 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72d73d-28da-4ca3-9d04-e9e688262ffd None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:48.100950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 300/607] 10.222.0.25 () {56 vars in 1137 bytes} [Mon Jul 11 11:56:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:48.101747 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a35b9f-fdb1-4c7d-b6d6-8a8d1d1c3da5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:48.131481 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b938feb-8c30-414d-b84e-4dcdfed08280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:48.132298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b938feb-8c30-414d-b84e-4dcdfed08280 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:48.132581 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b938feb-8c30-414d-b84e-4dcdfed08280 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:48.132847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b938feb-8c30-414d-b84e-4dcdfed08280 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:48.143105 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b938feb-8c30-414d-b84e-4dcdfed08280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:48.151214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-1b938feb-8c30-414d-b84e-4dcdfed08280 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:48.151214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:48.151214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:48.151214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:48.151214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:48.151214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:48.151214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:48.151214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:48.151214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:48.151214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:48.151214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:48.151214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:48.151214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:48.151214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:48.151214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:48.151214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:48.152801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:48.152801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:48.152801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:48.152801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:48.152801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:48.152801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:48.152801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:48.152801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:48.152801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:48.152801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:48.152801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:48.152801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:48.152801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:48.152801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:48.152801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:48.152801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:48.153731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:48.153731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:48.153731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:48.153731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:48.153731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:48.153731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:48.153731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:48.153731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:48.153731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:48.153731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:48.153731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:56:48.153731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:48.153731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 308/608] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:56:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:48.153731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b938feb-8c30-414d-b84e-4dcdfed08280 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:48.208678 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a35b9f-fdb1-4c7d-b6d6-8a8d1d1c3da5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:48.244142 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd2887-e44a-4082-bf7c-2fa0c5c1e8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:48.245143 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd2887-e44a-4082-bf7c-2fa0c5c1e8cf None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:48.245397 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd2887-e44a-4082-bf7c-2fa0c5c1e8cf None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:48.245669 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd2887-e44a-4082-bf7c-2fa0c5c1e8cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:48.252252 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd2887-e44a-4082-bf7c-2fa0c5c1e8cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:48.253703 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd2887-e44a-4082-bf7c-2fa0c5c1e8cf None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:48.257642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b938feb-8c30-414d-b84e-4dcdfed08280 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:48.267720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-90dd2887-e44a-4082-bf7c-2fa0c5c1e8cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:48.267720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:48.267720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:48.267720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:48.267720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:48.267720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:48.267720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:48.267720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:48.267720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:48.267720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:48.267720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:48.267720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:48.267720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:56:48.267720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:56:48.267720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:48.268593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:48.269450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:56:48.269450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:56:48.269450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:56:48.269450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:56:48.269450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:56:48.269450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:56:48.269450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:48.269450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:48.269450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 301/609] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:48.270060 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd2887-e44a-4082-bf7c-2fa0c5c1e8cf None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:48.296343 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ca464-399c-413e-a46b-5d73f894ce29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:48.297003 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ca464-399c-413e-a46b-5d73f894ce29 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:48.297286 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ca464-399c-413e-a46b-5d73f894ce29 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:48.297562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ca464-399c-413e-a46b-5d73f894ce29 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:48.298299 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ca464-399c-413e-a46b-5d73f894ce29 None admin] RBAC: Adding query filter params (name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:48.298586 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:48.298738 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ca464-399c-413e-a46b-5d73f894ce29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:48.300005 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ca464-399c-413e-a46b-5d73f894ce29 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:48.308318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 309/610] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Jul 11 11:56:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:48.309114 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ca464-399c-413e-a46b-5d73f894ce29 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:48.331576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:48.377097 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd2887-e44a-4082-bf7c-2fa0c5c1e8cf None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:48.409316 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ca464-399c-413e-a46b-5d73f894ce29 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:48.410751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977a1ac-8513-4d58-9c00-40061027b213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:48.411395 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977a1ac-8513-4d58-9c00-40061027b213 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:48.411683 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977a1ac-8513-4d58-9c00-40061027b213 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:48.411954 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977a1ac-8513-4d58-9c00-40061027b213 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:48.444934 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca662bf-29ef-48f1-a50d-18648e100332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:48.445593 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca662bf-29ef-48f1-a50d-18648e100332 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:48.445872 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca662bf-29ef-48f1-a50d-18648e100332 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:48.446141 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca662bf-29ef-48f1-a50d-18648e100332 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:48.446904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca662bf-29ef-48f1-a50d-18648e100332 None admin] RBAC: Adding query filter params (name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:48.447203 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca662bf-29ef-48f1-a50d-18648e100332 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:48.449216 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca662bf-29ef-48f1-a50d-18648e100332 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:48.457216 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 310/611] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Jul 11 11:56:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:48.458073 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca662bf-29ef-48f1-a50d-18648e100332 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:48.482773 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977a1ac-8513-4d58-9c00-40061027b213 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:48.484229 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977a1ac-8513-4d58-9c00-40061027b213 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:48.510552 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:48.539841 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:48.559639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca662bf-29ef-48f1-a50d-18648e100332 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:48.585489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 302/612] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:48.586261 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977a1ac-8513-4d58-9c00-40061027b213 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:48.594005 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46036079-26f6-432c-b157-4abfd5815b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:48.594664 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46036079-26f6-432c-b157-4abfd5815b44 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:48.594979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46036079-26f6-432c-b157-4abfd5815b44 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:48.595256 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46036079-26f6-432c-b157-4abfd5815b44 None admin] PATH_INFO: `/v3/projects` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:48.596033 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46036079-26f6-432c-b157-4abfd5815b44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:48.596340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46036079-26f6-432c-b157-4abfd5815b44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:48.597778 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46036079-26f6-432c-b157-4abfd5815b44 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:48.610092 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 311/613] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:56:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:48.610924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46036079-26f6-432c-b157-4abfd5815b44 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:48.693428 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977a1ac-8513-4d58-9c00-40061027b213 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:48.708597 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46036079-26f6-432c-b157-4abfd5815b44 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:48.721336 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:48.729526 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeae7b-61f1-4a1e-821b-add0a2dda844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:48.730310 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeae7b-61f1-4a1e-821b-add0a2dda844 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:48.730597 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeae7b-61f1-4a1e-821b-add0a2dda844 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:48.730911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeae7b-61f1-4a1e-821b-add0a2dda844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:48.740865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadeae7b-61f1-4a1e-821b-add0a2dda844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:48.741640 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26342f9f-09fc-42d9-8b7d-341c456139dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:48.742320 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadeae7b-61f1-4a1e-821b-add0a2dda844 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:48.742414 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26342f9f-09fc-42d9-8b7d-341c456139dd None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:48.742684 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26342f9f-09fc-42d9-8b7d-341c456139dd None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:48.742986 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26342f9f-09fc-42d9-8b7d-341c456139dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:48.753375 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26342f9f-09fc-42d9-8b7d-341c456139dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:48.754862 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26342f9f-09fc-42d9-8b7d-341c456139dd None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:48.756622 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:48.761470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-eadeae7b-61f1-4a1e-821b-add0a2dda844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:48.761470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:48.761470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:48.761470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:48.761470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:48.761470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:48.761470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:48.761470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:48.761470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:48.761470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:48.761470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:48.761470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:48.761470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:48.761470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:48.761470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:48.762491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:48.763393 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:48.763393 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:48.763393 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:48.763393 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:48.763393 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 303/614] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:48.764378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeae7b-61f1-4a1e-821b-add0a2dda844 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:48.777224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-26342f9f-09fc-42d9-8b7d-341c456139dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:48.777224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:48.777224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:48.777224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:48.777224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:48.777224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:48.777224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:48.777224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:48.777224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:48.777224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:48.777224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:48.777224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:48.777224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:48.777224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:48.777224 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:48.778187 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:48.779693 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:48.779693 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:48.779693 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:48.779693 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:48.779693 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 312/615] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:48.779693 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26342f9f-09fc-42d9-8b7d-341c456139dd None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:48.864561 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeae7b-61f1-4a1e-821b-add0a2dda844 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:48.880405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26342f9f-09fc-42d9-8b7d-341c456139dd None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:48.898043 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851a725-80d4-4a72-b138-344d9aa95c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:48.898848 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851a725-80d4-4a72-b138-344d9aa95c5a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:48.899132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851a725-80d4-4a72-b138-344d9aa95c5a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:48.899404 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851a725-80d4-4a72-b138-344d9aa95c5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:48.909692 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851a725-80d4-4a72-b138-344d9aa95c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:48.911176 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851a725-80d4-4a72-b138-344d9aa95c5a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:48.913779 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdd926-3e73-488d-92a9-63e52c0a219d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:48.914539 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdd926-3e73-488d-92a9-63e52c0a219d None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:48.914926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdd926-3e73-488d-92a9-63e52c0a219d None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:48.915304 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdd926-3e73-488d-92a9-63e52c0a219d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:48.916182 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdd926-3e73-488d-92a9-63e52c0a219d None admin] RBAC: Adding query filter params (role.id=22d318004ece47b3a0d4d3919bfebdc9, scope.project.id=6e452080fec045788d9bd5dfdb7a3c52, user.id=11550a0ca11041b0b9b175860f2b6633) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:48.916654 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdd926-3e73-488d-92a9-63e52c0a219d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:48.918217 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdd926-3e73-488d-92a9-63e52c0a219d None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:48.924093 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 313/616] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:56:48 2022] GET /identity/v3/role_assignments?user.id=11550a0ca11041b0b9b175860f2b6633&scope.project.id=6e452080fec045788d9bd5dfdb7a3c52&role.id=22d318004ece47b3a0d4d3919bfebdc9 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:48.924942 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdd926-3e73-488d-92a9-63e52c0a219d None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:48.927790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-6851a725-80d4-4a72-b138-344d9aa95c5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:48.927790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:48.927790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:48.927790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:48.927790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:48.927790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:48.927790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:48.927790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:48.927790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:48.927790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:48.927790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:48.927790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:48.927790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:48.927790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:48.927790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:48.928675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:48.929544 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:48.929544 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:48.929544 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:48.929544 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:48.929544 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 304/617] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:48.929827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851a725-80d4-4a72-b138-344d9aa95c5a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:48.972951 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:48.999208 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:49.047872 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdd926-3e73-488d-92a9-63e52c0a219d None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:49.055314 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851a725-80d4-4a72-b138-344d9aa95c5a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:49.086620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bf585-9793-4be5-a7fa-b1a6f074368b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:49.087413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bf585-9793-4be5-a7fa-b1a6f074368b None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:49.087704 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bf585-9793-4be5-a7fa-b1a6f074368b None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:49.087981 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bf585-9793-4be5-a7fa-b1a6f074368b None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:49.088960 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bf585-9793-4be5-a7fa-b1a6f074368b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:49.089278 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bf585-9793-4be5-a7fa-b1a6f074368b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:49.090684 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bf585-9793-4be5-a7fa-b1a6f074368b None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:49.094223 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70a54e-a89e-4dea-ae21-20a6b30f1705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:49.094916 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70a54e-a89e-4dea-ae21-20a6b30f1705 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:49.095193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70a54e-a89e-4dea-ae21-20a6b30f1705 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:49.095464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70a54e-a89e-4dea-ae21-20a6b30f1705 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:49.096181 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70a54e-a89e-4dea-ae21-20a6b30f1705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:49.096480 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70a54e-a89e-4dea-ae21-20a6b30f1705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:49.097840 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70a54e-a89e-4dea-ae21-20a6b30f1705 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:49.105513 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 314/618] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:49.106691 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bf585-9793-4be5-a7fa-b1a6f074368b None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:49.111646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 305/619] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:49.112341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70a54e-a89e-4dea-ae21-20a6b30f1705 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:49.224493 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:49.234533 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bf585-9793-4be5-a7fa-b1a6f074368b None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:49.236725 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70a54e-a89e-4dea-ae21-20a6b30f1705 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:49.253684 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:49.271631 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054b44d-73d2-4ca2-99ea-129df67e0421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:49.272293 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054b44d-73d2-4ca2-99ea-129df67e0421 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:49.272574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054b44d-73d2-4ca2-99ea-129df67e0421 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:49.272840 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054b44d-73d2-4ca2-99ea-129df67e0421 None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:49.273355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9ae6d-43c6-42b9-bb0f-e87ff68490d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:49.273550 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054b44d-73d2-4ca2-99ea-129df67e0421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:49.273847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054b44d-73d2-4ca2-99ea-129df67e0421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:49.274175 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9ae6d-43c6-42b9-bb0f-e87ff68490d2 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:49.274461 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9ae6d-43c6-42b9-bb0f-e87ff68490d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:49.274765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9ae6d-43c6-42b9-bb0f-e87ff68490d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:49.275316 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054b44d-73d2-4ca2-99ea-129df67e0421 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:49.283072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9ae6d-43c6-42b9-bb0f-e87ff68490d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:49.284527 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9ae6d-43c6-42b9-bb0f-e87ff68490d2 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:49.288368 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 315/620] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:49.289328 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054b44d-73d2-4ca2-99ea-129df67e0421 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:49.299522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-43e9ae6d-43c6-42b9-bb0f-e87ff68490d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 11:56:49.299522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:49.299522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:49.299522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:49.299522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:49.299522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:49.299522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:49.299522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:49.299522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:49.299522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:49.299522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:49.299522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:49.299522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:56:49.299522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:56:49.299522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:56:49.299522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:49.300546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:49.301466 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:49.301466 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:49.301466 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:56:49.301466 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:56:49.301466 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:56:49.301466 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:56:49.301466 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:56:49.301466 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:56:49.301466 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 11:56:49.301466 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:49.301466 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 306/621] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:56:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:49.302061 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9ae6d-43c6-42b9-bb0f-e87ff68490d2 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:49.403644 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054b44d-73d2-4ca2-99ea-129df67e0421 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:49.417360 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9ae6d-43c6-42b9-bb0f-e87ff68490d2 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:49.439842 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ce408-28cf-44ac-b3d8-1bfb2994cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:49.440565 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ce408-28cf-44ac-b3d8-1bfb2994cbc8 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:49.440855 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ce408-28cf-44ac-b3d8-1bfb2994cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:49.441127 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ce408-28cf-44ac-b3d8-1bfb2994cbc8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:49.449534 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ce408-28cf-44ac-b3d8-1bfb2994cbc8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:49.451026 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ce408-28cf-44ac-b3d8-1bfb2994cbc8 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:49.455310 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d12e0-c307-425a-95c5-0aecf6942269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:49.456327 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d12e0-c307-425a-95c5-0aecf6942269 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:49.456797 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d12e0-c307-425a-95c5-0aecf6942269 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:49.457256 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d12e0-c307-425a-95c5-0aecf6942269 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:49.464590 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d12e0-c307-425a-95c5-0aecf6942269 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:49.465417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-4a3ce408-28cf-44ac-b3d8-1bfb2994cbc8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 11:56:49.465417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:49.465417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:49.465417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:49.465417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:49.465417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:49.465417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:49.465417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:49.465417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:49.465417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:49.465417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:49.465417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:49.465417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:56:49.465417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:56:49.465417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:56:49.465417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:49.466547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:49.467566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:49.467566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:49.467566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:56:49.467566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:56:49.467566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:56:49.467566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:56:49.467566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:56:49.467566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:56:49.467566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 11:56:49.467566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:49.467566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 316/622] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:49.468221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ce408-28cf-44ac-b3d8-1bfb2994cbc8 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:49.469259 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d12e0-c307-425a-95c5-0aecf6942269 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:49.490377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-175d12e0-c307-425a-95c5-0aecf6942269 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:49.490377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:49.490377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:49.490377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:49.490377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:49.490377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:49.490377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:49.490377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:49.490377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:49.490377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:49.490377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:49.490377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:49.490377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:56:49.490377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:56:49.490377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:49.491355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:49.492246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:56:49.492246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:56:49.492246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:56:49.492246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:56:49.492246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:56:49.492246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:56:49.492246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:49.492246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:49.492246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 307/623] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:49.493420 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d12e0-c307-425a-95c5-0aecf6942269 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:49.508718 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:49.552076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:49.612823 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d12e0-c307-425a-95c5-0aecf6942269 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:49.623485 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ce408-28cf-44ac-b3d8-1bfb2994cbc8 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:49.651972 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cb9d3-b1a2-4999-9d0c-52f40b94aa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:49.653019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cb9d3-b1a2-4999-9d0c-52f40b94aa48 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:49.653477 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cb9d3-b1a2-4999-9d0c-52f40b94aa48 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:49.653920 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cb9d3-b1a2-4999-9d0c-52f40b94aa48 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:49.654942 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cb9d3-b1a2-4999-9d0c-52f40b94aa48 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:49.655254 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cb9d3-b1a2-4999-9d0c-52f40b94aa48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:49.656704 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cb9d3-b1a2-4999-9d0c-52f40b94aa48 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:49.659285 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15882ce9-761c-490f-9405-5f5737c6bc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:49.659957 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15882ce9-761c-490f-9405-5f5737c6bc43 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:49.660244 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15882ce9-761c-490f-9405-5f5737c6bc43 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:49.660524 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15882ce9-761c-490f-9405-5f5737c6bc43 None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:49.661353 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15882ce9-761c-490f-9405-5f5737c6bc43 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:49.661667 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15882ce9-761c-490f-9405-5f5737c6bc43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:49.663109 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15882ce9-761c-490f-9405-5f5737c6bc43 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:49.675997 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 308/624] 10.222.0.25 () {56 vars in 1137 bytes} [Mon Jul 11 11:56:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:49.677144 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cb9d3-b1a2-4999-9d0c-52f40b94aa48 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:49.685301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 317/625] 10.222.0.25 () {56 vars in 1139 bytes} [Mon Jul 11 11:56:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:49.686225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15882ce9-761c-490f-9405-5f5737c6bc43 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:49.751862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:49.784437 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cb9d3-b1a2-4999-9d0c-52f40b94aa48 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:49.788763 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:49.797911 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15882ce9-761c-490f-9405-5f5737c6bc43 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:49.825418 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6e8ec-1291-4857-9e9e-f4cd3fa0c922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:49.826090 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6e8ec-1291-4857-9e9e-f4cd3fa0c922 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:49.826379 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6e8ec-1291-4857-9e9e-f4cd3fa0c922 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:49.826656 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6e8ec-1291-4857-9e9e-f4cd3fa0c922 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:49.827516 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6e8ec-1291-4857-9e9e-f4cd3fa0c922 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:49.827775 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6e8ec-1291-4857-9e9e-f4cd3fa0c922 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:49.829221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6e8ec-1291-4857-9e9e-f4cd3fa0c922 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:49.833500 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9129370-cd55-46e0-b8b1-563f9e2ccd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:49.834141 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9129370-cd55-46e0-b8b1-563f9e2ccd4a None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:49.834424 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9129370-cd55-46e0-b8b1-563f9e2ccd4a None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:49.834697 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9129370-cd55-46e0-b8b1-563f9e2ccd4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:49.846468 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 309/626] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:56:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:49.846468 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6e8ec-1291-4857-9e9e-f4cd3fa0c922 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:49.910421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9129370-cd55-46e0-b8b1-563f9e2ccd4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:49.912129 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9129370-cd55-46e0-b8b1-563f9e2ccd4a None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:49.951087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6e8ec-1291-4857-9e9e-f4cd3fa0c922 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:49.980498 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:49.988196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b15a03-73ae-4a69-97ae-f65967df3c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:49.989008 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b15a03-73ae-4a69-97ae-f65967df3c56 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:49.989293 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b15a03-73ae-4a69-97ae-f65967df3c56 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:49.989617 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b15a03-73ae-4a69-97ae-f65967df3c56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:50.011514 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:50.023116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 318/627] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:50.023116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9129370-cd55-46e0-b8b1-563f9e2ccd4a None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:50.069535 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b15a03-73ae-4a69-97ae-f65967df3c56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:50.071676 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b15a03-73ae-4a69-97ae-f65967df3c56 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:50.125157 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9129370-cd55-46e0-b8b1-563f9e2ccd4a None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:50.161253 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5df018-344b-4c32-9ae9-6c835ced3c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:50.161917 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5df018-344b-4c32-9ae9-6c835ced3c2a None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:50.162196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5df018-344b-4c32-9ae9-6c835ced3c2a None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:50.162464 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5df018-344b-4c32-9ae9-6c835ced3c2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:50.166522 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5df018-344b-4c32-9ae9-6c835ced3c2a None admin] RBAC: Adding query filter params (role.id=22d318004ece47b3a0d4d3919bfebdc9, scope.project.id=6e452080fec045788d9bd5dfdb7a3c52, user.id=dce9ec24be9049bfacddcf3c068f2f65) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:50.167452 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5df018-344b-4c32-9ae9-6c835ced3c2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:50.168473 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5df018-344b-4c32-9ae9-6c835ced3c2a None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:50.187035 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 319/628] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:56:50 2022] GET /identity/v3/role_assignments?user.id=dce9ec24be9049bfacddcf3c068f2f65&scope.project.id=6e452080fec045788d9bd5dfdb7a3c52&role.id=22d318004ece47b3a0d4d3919bfebdc9 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:50.187035 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5df018-344b-4c32-9ae9-6c835ced3c2a None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:50.198081 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 310/629] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:50.203839 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b15a03-73ae-4a69-97ae-f65967df3c56 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:50.246783 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:50.268522 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:50.320844 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5df018-344b-4c32-9ae9-6c835ced3c2a None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:50.344141 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b15a03-73ae-4a69-97ae-f65967df3c56 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:50.366263 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a2a18-bcfc-4986-993f-9f0479f15ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:50.367098 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a2a18-bcfc-4986-993f-9f0479f15ac0 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:50.367381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a2a18-bcfc-4986-993f-9f0479f15ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:50.368099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a2a18-bcfc-4986-993f-9f0479f15ac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:50.383956 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a2a18-bcfc-4986-993f-9f0479f15ac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:50.385893 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59156419-288a-41bf-b5cf-4bf985988ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:50.386692 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59156419-288a-41bf-b5cf-4bf985988ec2 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:50.387019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59156419-288a-41bf-b5cf-4bf985988ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:50.387282 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a2a18-bcfc-4986-993f-9f0479f15ac0 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:50.387415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59156419-288a-41bf-b5cf-4bf985988ec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:50.400172 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59156419-288a-41bf-b5cf-4bf985988ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:50.402268 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59156419-288a-41bf-b5cf-4bf985988ec2 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:50.409718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-d66a2a18-bcfc-4986-993f-9f0479f15ac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:50.409718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:50.409718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:50.409718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:50.409718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:50.409718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:50.409718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:50.409718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:50.409718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:50.409718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:50.409718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:50.409718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:50.409718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:50.409718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:50.409718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:50.410653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:50.411559 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:50.411559 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:50.411559 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:50.411559 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:50.411775 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 320/630] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:50.418675 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a2a18-bcfc-4986-993f-9f0479f15ac0 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:50.423655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-59156419-288a-41bf-b5cf-4bf985988ec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:50.423655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:50.423655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:50.423655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:50.423655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:50.423655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:50.423655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:50.423655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:50.423655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:50.423655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:50.423655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:50.423655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:50.423655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:50.423655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:50.423655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:50.424508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:50.425363 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:50.425363 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:50.425363 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:50.425363 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:50.426056 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 311/631] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:50.433381 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59156419-288a-41bf-b5cf-4bf985988ec2 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:50.532708 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:50.542173 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a2a18-bcfc-4986-993f-9f0479f15ac0 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:50.555437 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59156419-288a-41bf-b5cf-4bf985988ec2 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:50.557847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:50.593035 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42e872-2f29-402c-9a28-943881d6e40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:50.594587 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42e872-2f29-402c-9a28-943881d6e40a None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:50.595109 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42e872-2f29-402c-9a28-943881d6e40a None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:50.595827 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42e872-2f29-402c-9a28-943881d6e40a None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:50.596846 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42e872-2f29-402c-9a28-943881d6e40a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:50.597292 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42e872-2f29-402c-9a28-943881d6e40a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:50.599031 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42e872-2f29-402c-9a28-943881d6e40a None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:50.599809 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d50b9-3fb9-4995-91a5-653cb0893f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:50.600575 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d50b9-3fb9-4995-91a5-653cb0893f5c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:50.600970 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d50b9-3fb9-4995-91a5-653cb0893f5c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:50.601350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d50b9-3fb9-4995-91a5-653cb0893f5c None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:50.602191 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d50b9-3fb9-4995-91a5-653cb0893f5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:50.602573 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d50b9-3fb9-4995-91a5-653cb0893f5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:50.604912 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d50b9-3fb9-4995-91a5-653cb0893f5c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:50.615899 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 321/632] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:50.621939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42e872-2f29-402c-9a28-943881d6e40a None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:50.622987 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 312/633] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:50.627712 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d50b9-3fb9-4995-91a5-653cb0893f5c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:50.741289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42e872-2f29-402c-9a28-943881d6e40a None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:50.743403 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d50b9-3fb9-4995-91a5-653cb0893f5c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:50.778927 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961be1f-e051-4c3e-9d69-bebf42c80fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:50.779732 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961be1f-e051-4c3e-9d69-bebf42c80fe4 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:50.780024 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961be1f-e051-4c3e-9d69-bebf42c80fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:50.780291 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961be1f-e051-4c3e-9d69-bebf42c80fe4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:50.781652 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0a13c-ca0d-4341-b0a7-922361e942a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:50.782698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0a13c-ca0d-4341-b0a7-922361e942a5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:50.783449 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0a13c-ca0d-4341-b0a7-922361e942a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:50.783870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0a13c-ca0d-4341-b0a7-922361e942a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:50.787741 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961be1f-e051-4c3e-9d69-bebf42c80fe4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:50.789218 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961be1f-e051-4c3e-9d69-bebf42c80fe4 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:50.792834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0a13c-ca0d-4341-b0a7-922361e942a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:50.794495 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0a13c-ca0d-4341-b0a7-922361e942a5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:50.805898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-c961be1f-e051-4c3e-9d69-bebf42c80fe4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:50.805898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:50.805898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:50.805898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:50.805898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:50.805898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:50.805898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:50.805898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:50.805898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:50.805898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:50.805898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:50.805898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:50.805898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:56:50.805898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:56:50.805898 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:50.807574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:50.808686 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:56:50.808686 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:56:50.808686 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:56:50.808686 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:56:50.808686 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:56:50.808686 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:56:50.808686 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:50.808686 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:50.808686 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 322/634] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:50.812458 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-90f0a13c-ca0d-4341-b0a7-922361e942a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:50.812458 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:50.812458 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:50.812458 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:50.812458 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:50.812458 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:50.812458 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:50.812458 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:50.812458 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:50.812458 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:50.812458 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:50.812458 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:50.812458 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:56:50.812458 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:56:50.812458 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:50.813286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:50.814154 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:56:50.814154 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:56:50.814154 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:56:50.814154 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:56:50.814154 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:56:50.814154 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:56:50.814154 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:50.814154 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:50.814567 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961be1f-e051-4c3e-9d69-bebf42c80fe4 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:50.816197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 313/635] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:50.821670 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0a13c-ca0d-4341-b0a7-922361e942a5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:50.827040 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:50.857818 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:50.936321 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961be1f-e051-4c3e-9d69-bebf42c80fe4 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:50.961625 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0a13c-ca0d-4341-b0a7-922361e942a5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:50.978467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a8b20-d6f3-4a77-ae96-79028ba7291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:50.980462 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a8b20-d6f3-4a77-ae96-79028ba7291f None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:50.981403 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a8b20-d6f3-4a77-ae96-79028ba7291f None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:50.981868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a8b20-d6f3-4a77-ae96-79028ba7291f None admin] PATH_INFO: `/v3/projects` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:50.983169 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a8b20-d6f3-4a77-ae96-79028ba7291f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:50.983689 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a8b20-d6f3-4a77-ae96-79028ba7291f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:50.985917 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a8b20-d6f3-4a77-ae96-79028ba7291f None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:51.002121 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 323/636] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:56:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:51.008068 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a8b20-d6f3-4a77-ae96-79028ba7291f None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:51.010097 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b254c-84e6-4322-9392-6cede03e3b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:51.011315 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b254c-84e6-4322-9392-6cede03e3b21 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:51.011777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b254c-84e6-4322-9392-6cede03e3b21 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:51.012245 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b254c-84e6-4322-9392-6cede03e3b21 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:51.013210 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b254c-84e6-4322-9392-6cede03e3b21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:51.013723 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b254c-84e6-4322-9392-6cede03e3b21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:51.015370 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b254c-84e6-4322-9392-6cede03e3b21 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:51.029555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 314/637] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:56:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:51.037871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b254c-84e6-4322-9392-6cede03e3b21 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:51.102701 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:51.106614 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:51.120830 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a8b20-d6f3-4a77-ae96-79028ba7291f None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:51.163357 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b254c-84e6-4322-9392-6cede03e3b21 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:51.170272 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dba95-4f59-4c30-b2b6-ee84ac7b1e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:51.174008 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dba95-4f59-4c30-b2b6-ee84ac7b1e19 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:51.174008 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dba95-4f59-4c30-b2b6-ee84ac7b1e19 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:51.174008 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dba95-4f59-4c30-b2b6-ee84ac7b1e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:51.174008 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dba95-4f59-4c30-b2b6-ee84ac7b1e19 None admin] RBAC: Adding query filter params (role.id=22d318004ece47b3a0d4d3919bfebdc9, scope.project.id=6e452080fec045788d9bd5dfdb7a3c52, user.id=009ac389925143f1954c5d1971155318) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:51.174008 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dba95-4f59-4c30-b2b6-ee84ac7b1e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:51.176527 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dba95-4f59-4c30-b2b6-ee84ac7b1e19 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:51.190759 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 324/638] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:56:51 2022] GET /identity/v3/role_assignments?user.id=009ac389925143f1954c5d1971155318&scope.project.id=6e452080fec045788d9bd5dfdb7a3c52&role.id=22d318004ece47b3a0d4d3919bfebdc9 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:51.217301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a287d06-ad70-477f-9b02-f9d0c9baf2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:51.217963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a287d06-ad70-477f-9b02-f9d0c9baf2e3 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:51.218309 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a287d06-ad70-477f-9b02-f9d0c9baf2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:51.218585 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a287d06-ad70-477f-9b02-f9d0c9baf2e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:51.219454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a287d06-ad70-477f-9b02-f9d0c9baf2e3 None admin] RBAC: Adding query filter params (role.id=22d318004ece47b3a0d4d3919bfebdc9, scope.project.id=6e452080fec045788d9bd5dfdb7a3c52, user.id=2b005858b98e4e27b2536d9ea3908f09) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:51.219762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a287d06-ad70-477f-9b02-f9d0c9baf2e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:51.221285 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a287d06-ad70-477f-9b02-f9d0c9baf2e3 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:51.229455 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 315/639] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:56:51 2022] GET /identity/v3/role_assignments?user.id=2b005858b98e4e27b2536d9ea3908f09&scope.project.id=6e452080fec045788d9bd5dfdb7a3c52&role.id=22d318004ece47b3a0d4d3919bfebdc9 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:51.337577 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b082371-fd47-4e17-a792-8422e37a89fd None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:51.337756 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b082371-fd47-4e17-a792-8422e37a89fd None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:51.338747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b082371-fd47-4e17-a792-8422e37a89fd None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:51.340701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 325/640] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:51.346266 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e7c4-f7ad-454d-9fa3-215c1e116206 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:51.346560 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e7c4-f7ad-454d-9fa3-215c1e116206 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:51.346848 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e7c4-f7ad-454d-9fa3-215c1e116206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:51.366503 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-93b4e7c4-f7ad-454d-9fa3-215c1e116206 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:51.367776 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-93b4e7c4-f7ad-454d-9fa3-215c1e116206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:51.443212 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 316/641] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:51.469418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b082371-fd47-4e17-a792-8422e37a89fd None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:51.591333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b082371-fd47-4e17-a792-8422e37a89fd None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:51.628618 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441598a-6875-434c-aa94-611af7dfd1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:51.629473 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441598a-6875-434c-aa94-611af7dfd1e7 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:51.629767 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441598a-6875-434c-aa94-611af7dfd1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:51.630047 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441598a-6875-434c-aa94-611af7dfd1e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:51.642014 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441598a-6875-434c-aa94-611af7dfd1e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:51.650170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-2441598a-6875-434c-aa94-611af7dfd1e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:56:51.650170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:51.650170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:51.650170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:51.650170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:51.650170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:51.650170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:51.650170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:51.650170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:51.650170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:51.650170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:51.650170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:51.650170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:51.650170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:51.650170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:51.650170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:51.651926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:51.651926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:51.651926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:51.651926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:51.651926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:51.651926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:51.651926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:51.651926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:51.651926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:51.651926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:51.651926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:51.651926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:51.651926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:51.651926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:51.651926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:51.651926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:51.652835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:51.652835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:51.652835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:51.652835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:51.652835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:51.652835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:51.652835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:51.652835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:51.652835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:51.652835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:51.652835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:56:51.652835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:51.652835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 326/642] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:56:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:51.659640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4e7c4-f7ad-454d-9fa3-215c1e116206 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:51.718862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:51.765953 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4e7c4-f7ad-454d-9fa3-215c1e116206 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:51.801365 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde49a0-89fa-46ca-8701-edb79622963c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:51.802404 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde49a0-89fa-46ca-8701-edb79622963c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:51.802930 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde49a0-89fa-46ca-8701-edb79622963c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:51.803424 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde49a0-89fa-46ca-8701-edb79622963c None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:51.804371 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde49a0-89fa-46ca-8701-edb79622963c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:51.804877 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde49a0-89fa-46ca-8701-edb79622963c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:51.806446 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde49a0-89fa-46ca-8701-edb79622963c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:51.816491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 317/643] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:51.823848 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441598a-6875-434c-aa94-611af7dfd1e7 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:51.844552 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:51.937248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441598a-6875-434c-aa94-611af7dfd1e7 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:51.976764 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024189e4-92ab-4e32-adb5-8aa48c7b0772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:51.977720 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024189e4-92ab-4e32-adb5-8aa48c7b0772 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:51.978277 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024189e4-92ab-4e32-adb5-8aa48c7b0772 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:51.978561 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024189e4-92ab-4e32-adb5-8aa48c7b0772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:51.990284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024189e4-92ab-4e32-adb5-8aa48c7b0772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:51.991835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024189e4-92ab-4e32-adb5-8aa48c7b0772 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:52.010849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-024189e4-92ab-4e32-adb5-8aa48c7b0772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:52.010849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:52.010849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:52.010849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:52.010849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:52.010849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:52.010849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:52.010849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:52.010849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:52.010849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:52.010849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:52.010849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:52.010849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:52.010849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:52.010849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:52.011785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:52.012659 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:52.012659 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:52.012659 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:52.012659 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:52.012659 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 327/644] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:52.018960 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde49a0-89fa-46ca-8701-edb79622963c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:52.128596 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde49a0-89fa-46ca-8701-edb79622963c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:52.146623 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:52.176944 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95066c-0cf2-4b20-b233-b61f89159d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:52.177637 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95066c-0cf2-4b20-b233-b61f89159d8b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:52.177918 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95066c-0cf2-4b20-b233-b61f89159d8b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:52.178185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95066c-0cf2-4b20-b233-b61f89159d8b None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:52.182743 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95066c-0cf2-4b20-b233-b61f89159d8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:52.182743 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95066c-0cf2-4b20-b233-b61f89159d8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:52.182743 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95066c-0cf2-4b20-b233-b61f89159d8b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:52.197153 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 318/645] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:52.202395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024189e4-92ab-4e32-adb5-8aa48c7b0772 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:52.278944 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:52.316884 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024189e4-92ab-4e32-adb5-8aa48c7b0772 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:52.353342 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7b8d3-9cba-4c5e-b386-0182f78ddde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:52.354997 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7b8d3-9cba-4c5e-b386-0182f78ddde9 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:52.355514 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7b8d3-9cba-4c5e-b386-0182f78ddde9 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:52.355995 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7b8d3-9cba-4c5e-b386-0182f78ddde9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:52.364765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7b8d3-9cba-4c5e-b386-0182f78ddde9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:52.366459 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7b8d3-9cba-4c5e-b386-0182f78ddde9 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:52.382284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-98e7b8d3-9cba-4c5e-b386-0182f78ddde9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:56:52.382284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:52.382284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:52.382284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:52.382284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:52.382284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:52.382284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:52.382284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:52.382284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:52.382284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:52.382284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:52.382284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:52.382284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:56:52.382284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:56:52.382284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:56:52.382284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:52.383259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:52.384185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:52.384185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:52.384185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:56:52.384185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:56:52.384185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:56:52.384185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:56:52.384185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:56:52.384185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:56:52.384185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:56:52.384185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:52.386908 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 328/646] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Jul 11 11:56:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:52.397987 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95066c-0cf2-4b20-b233-b61f89159d8b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:52.511461 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95066c-0cf2-4b20-b233-b61f89159d8b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:52.551780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79fc7e-dd04-46a8-9069-7ab880f270c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:52.552845 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79fc7e-dd04-46a8-9069-7ab880f270c5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:52.553339 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79fc7e-dd04-46a8-9069-7ab880f270c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:52.553851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79fc7e-dd04-46a8-9069-7ab880f270c5 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:52.554946 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79fc7e-dd04-46a8-9069-7ab880f270c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:52.555493 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79fc7e-dd04-46a8-9069-7ab880f270c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:52.557241 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79fc7e-dd04-46a8-9069-7ab880f270c5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:52.578256 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 319/647] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Jul 11 11:56:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:52.583808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7b8d3-9cba-4c5e-b386-0182f78ddde9 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:52.614253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97692d-25d9-449c-a683-e36b27ca484f None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:52.614586 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97692d-25d9-449c-a683-e36b27ca484f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:52.614846 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97692d-25d9-449c-a683-e36b27ca484f None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:52.616460 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 320/648] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:52.622378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33bca3-4fad-4de9-9438-c9283c5b9aff None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:52.622670 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33bca3-4fad-4de9-9438-c9283c5b9aff None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:52.623072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33bca3-4fad-4de9-9438-c9283c5b9aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:52.645367 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7c33bca3-4fad-4de9-9438-c9283c5b9aff None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:52.646651 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7c33bca3-4fad-4de9-9438-c9283c5b9aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:52.685381 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:52.710146 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7b8d3-9cba-4c5e-b386-0182f78ddde9 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:52.739285 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:52.741598 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 321/649] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:52.752485 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c91e5-2022-425b-9fc5-5aeed8cb3943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:52.753137 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c91e5-2022-425b-9fc5-5aeed8cb3943 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:52.753420 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c91e5-2022-425b-9fc5-5aeed8cb3943 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:52.753752 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c91e5-2022-425b-9fc5-5aeed8cb3943 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:52.765986 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33bca3-4fad-4de9-9438-c9283c5b9aff None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:52.836557 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c91e5-2022-425b-9fc5-5aeed8cb3943 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:52.839300 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c91e5-2022-425b-9fc5-5aeed8cb3943 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:52.910484 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33bca3-4fad-4de9-9438-c9283c5b9aff None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:52.948948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 329/650] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:56:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 11:56:52.950183 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c91e5-2022-425b-9fc5-5aeed8cb3943 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:52.955826 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93685993-2dba-41df-b16c-11871f64bf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:52.956620 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93685993-2dba-41df-b16c-11871f64bf0f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:52.956903 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93685993-2dba-41df-b16c-11871f64bf0f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:52.957175 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93685993-2dba-41df-b16c-11871f64bf0f None admin] PATH_INFO: `/v3/services/image` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:52.957829 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93685993-2dba-41df-b16c-11871f64bf0f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:52.959249 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93685993-2dba-41df-b16c-11871f64bf0f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-93685993-2dba-41df-b16c-11871f64bf0f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:52.979118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:52.980340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:52.980340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:52.980340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:52.980340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:52.980340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:52.980340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:52.980340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:56:52.980340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:56:52.980340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:56:52.980340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:56:52.980340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:52.980340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:52.980340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:52.980340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:52.980340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:52.980340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:52.981178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:52.981178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:52.981178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:52.981178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:52.981178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:52.981178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:52.981178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:52.981178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:52.981178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:52.981178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:52.981178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:56:52.981178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:56:52.981178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:56:52.981178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:52.985587 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 322/651] 10.222.0.25 () {56 vars in 1105 bytes} [Mon Jul 11 11:56:52 2022] GET /identity/v3/services/image => generated 86 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:52.986692 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93685993-2dba-41df-b16c-11871f64bf0f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:52.989557 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:53.031232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:53.081109 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c91e5-2022-425b-9fc5-5aeed8cb3943 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:53.108009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93685993-2dba-41df-b16c-11871f64bf0f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:53.125748 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae97da3-4157-4ce1-b56e-06e2f22b751b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:53.126579 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae97da3-4157-4ce1-b56e-06e2f22b751b None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:53.127006 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae97da3-4157-4ce1-b56e-06e2f22b751b None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:53.127295 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae97da3-4157-4ce1-b56e-06e2f22b751b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:53.141960 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae97da3-4157-4ce1-b56e-06e2f22b751b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:53.144007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae97da3-4157-4ce1-b56e-06e2f22b751b None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:53.147355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d0b2c-b57d-4ef2-8ab2-019f764994de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:53.148605 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d0b2c-b57d-4ef2-8ab2-019f764994de None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:53.149247 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d0b2c-b57d-4ef2-8ab2-019f764994de None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:53.149747 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d0b2c-b57d-4ef2-8ab2-019f764994de None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:53.151428 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d0b2c-b57d-4ef2-8ab2-019f764994de None admin] RBAC: Adding query filter params (name=image) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:53.152003 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d0b2c-b57d-4ef2-8ab2-019f764994de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:53.153800 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d0b2c-b57d-4ef2-8ab2-019f764994de None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:53.159372 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 323/652] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:53.169107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d0b2c-b57d-4ef2-8ab2-019f764994de None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:53.169251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-1ae97da3-4157-4ce1-b56e-06e2f22b751b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:53.169251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:53.169251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:53.169251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:53.169251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:53.169251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:53.169251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:53.169251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:53.169251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:53.169251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:53.169251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:53.169251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:53.169251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:53.169251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:53.169251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:53.170087 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:53.170996 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:53.170996 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:53.170996 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:53.170996 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:53.170996 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 330/653] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:53.176213 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae97da3-4157-4ce1-b56e-06e2f22b751b None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:53.280918 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:53.289948 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d0b2c-b57d-4ef2-8ab2-019f764994de None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:53.292818 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:53.317694 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae97da3-4157-4ce1-b56e-06e2f22b751b None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:53.333828 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489231f-9735-405b-82b8-9bdb7830c2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:53.335323 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489231f-9735-405b-82b8-9bdb7830c2bd None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:53.335828 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489231f-9735-405b-82b8-9bdb7830c2bd None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:53.336324 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489231f-9735-405b-82b8-9bdb7830c2bd None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:53.337231 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489231f-9735-405b-82b8-9bdb7830c2bd None admin] RBAC: Adding query filter params (type=image) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:53.338408 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489231f-9735-405b-82b8-9bdb7830c2bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:53.344809 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489231f-9735-405b-82b8-9bdb7830c2bd None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:53.358882 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 324/654] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:53.367657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e846372-cc5a-4da7-866c-28f6ef7790b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:53.368720 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e846372-cc5a-4da7-866c-28f6ef7790b4 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:53.369291 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e846372-cc5a-4da7-866c-28f6ef7790b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:53.369783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e846372-cc5a-4da7-866c-28f6ef7790b4 None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:53.371884 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e846372-cc5a-4da7-866c-28f6ef7790b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:53.372454 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e846372-cc5a-4da7-866c-28f6ef7790b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:53.374139 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e846372-cc5a-4da7-866c-28f6ef7790b4 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:53.389467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 331/655] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:53.394602 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489231f-9735-405b-82b8-9bdb7830c2bd None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:53.520130 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489231f-9735-405b-82b8-9bdb7830c2bd None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:53.562062 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775bcc8-dcd5-411c-8bcd-9d094fc9222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:53.562900 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775bcc8-dcd5-411c-8bcd-9d094fc9222f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:53.563185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775bcc8-dcd5-411c-8bcd-9d094fc9222f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:53.563460 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775bcc8-dcd5-411c-8bcd-9d094fc9222f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:53.571906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775bcc8-dcd5-411c-8bcd-9d094fc9222f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:53.573628 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775bcc8-dcd5-411c-8bcd-9d094fc9222f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:53.589533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-5775bcc8-dcd5-411c-8bcd-9d094fc9222f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:53.589533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:53.589533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:53.589533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:53.589533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:53.589533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:53.589533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:53.589533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:53.589533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:53.589533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:53.589533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:53.589533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:53.589533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:56:53.589533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:56:53.589533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:53.590510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:53.591835 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:56:53.591835 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:56:53.591835 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:56:53.591835 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:56:53.591835 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:56:53.591835 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:56:53.591835 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:53.591835 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:53.591835 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 325/656] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:53.596729 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e846372-cc5a-4da7-866c-28f6ef7790b4 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:53.655189 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaba5a-d73f-4908-bc51-c6e817e2268d None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:53.655833 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaba5a-d73f-4908-bc51-c6e817e2268d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:53.656345 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faaba5a-d73f-4908-bc51-c6e817e2268d None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:53.658313 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 326/657] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:53.663687 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f4ba2-285d-4390-b21b-71e1c18d9295 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:53.664224 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f4ba2-285d-4390-b21b-71e1c18d9295 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:53.664708 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f4ba2-285d-4390-b21b-71e1c18d9295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:53.685156 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-1b1f4ba2-285d-4390-b21b-71e1c18d9295 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:53.686579 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-1b1f4ba2-285d-4390-b21b-71e1c18d9295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:53.701641 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:53.716722 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e846372-cc5a-4da7-866c-28f6ef7790b4 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:53.753348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc696b-90fe-4204-8dc4-6a2ab8defffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:53.754013 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc696b-90fe-4204-8dc4-6a2ab8defffe None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:53.754497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc696b-90fe-4204-8dc4-6a2ab8defffe None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:53.754605 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc696b-90fe-4204-8dc4-6a2ab8defffe None admin] PATH_INFO: `/v3/projects` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:53.755377 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc696b-90fe-4204-8dc4-6a2ab8defffe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:53.755690 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc696b-90fe-4204-8dc4-6a2ab8defffe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:53.757125 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc696b-90fe-4204-8dc4-6a2ab8defffe None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:53.759472 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 327/658] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:53.761349 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d9051-761b-49c1-9a2d-f58b273a004e None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:53.761640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d9051-761b-49c1-9a2d-f58b273a004e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:53.761914 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d9051-761b-49c1-9a2d-f58b273a004e None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:53.763351 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 328/659] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:53.768400 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dc840-5960-47ed-a501-f9ce0f2dacb1 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:53.770895 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dc840-5960-47ed-a501-f9ce0f2dacb1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:53.770895 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51dc840-5960-47ed-a501-f9ce0f2dacb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:53.778445 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:53.784954 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 332/660] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:56:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:53.787740 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc696b-90fe-4204-8dc4-6a2ab8defffe None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:53.788400 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-f51dc840-5960-47ed-a501-f9ce0f2dacb1 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:53.789732 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f51dc840-5960-47ed-a501-f9ce0f2dacb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:53.870839 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 329/661] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:53.872259 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51dc840-5960-47ed-a501-f9ce0f2dacb1 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:53.901250 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc696b-90fe-4204-8dc4-6a2ab8defffe None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:53.939659 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4c956-e78d-4d65-8773-6ccb1728d468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:53.940889 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4c956-e78d-4d65-8773-6ccb1728d468 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:53.941177 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4c956-e78d-4d65-8773-6ccb1728d468 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:53.941603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4c956-e78d-4d65-8773-6ccb1728d468 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:53.942261 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4c956-e78d-4d65-8773-6ccb1728d468 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:53.943667 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4c956-e78d-4d65-8773-6ccb1728d468 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:53.958094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-87e4c956-e78d-4d65-8773-6ccb1728d468 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:56:53.958094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:53.958094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:56:53.958094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:56:53.958094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:56:53.958094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:56:53.958094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:56:53.958094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:56:53.958094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:56:53.958094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:53.958094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:56:53.958094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:53.958094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:53.958094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:53.958094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:53.958094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:53.959077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:53.959077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:53.959077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:53.959077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:53.959077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:53.959077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:53.959077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:53.959077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:56:53.959077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:56:53.959077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:56:53.959077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:56:53.959077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:53.959077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:53.959077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:53.959077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:53.959077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:53.959914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:53.959914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:53.959914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:53.959914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:53.959914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:53.959914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:53.959914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:53.959914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:53.959914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:53.959914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:53.959914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:53.959914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:56:53.959914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:56:53.959914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:56:53.959914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:53.959914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 333/662] 10.222.0.25 () {56 vars in 1129 bytes} [Mon Jul 11 11:56:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:53.960774 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4c956-e78d-4d65-8773-6ccb1728d468 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:53.974604 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:54.003954 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51dc840-5960-47ed-a501-f9ce0f2dacb1 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:54.029942 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:54.046137 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29effb84-682f-4616-a80c-d984b9020adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:54.046837 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29effb84-682f-4616-a80c-d984b9020adc None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:54.047484 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29effb84-682f-4616-a80c-d984b9020adc None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:54.047772 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29effb84-682f-4616-a80c-d984b9020adc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:54.048913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29effb84-682f-4616-a80c-d984b9020adc None admin] RBAC: Adding query filter params (role.id=11fc9dc7c3664b2b8af8eee2462707b8, scope.project.id=6e452080fec045788d9bd5dfdb7a3c52, user.id=11550a0ca11041b0b9b175860f2b6633) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:54.049233 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29effb84-682f-4616-a80c-d984b9020adc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:54.050869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29effb84-682f-4616-a80c-d984b9020adc None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:54.057198 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 330/663] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:56:53 2022] GET /identity/v3/role_assignments?user.id=11550a0ca11041b0b9b175860f2b6633&scope.project.id=6e452080fec045788d9bd5dfdb7a3c52&role.id=11fc9dc7c3664b2b8af8eee2462707b8 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:54.058515 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29effb84-682f-4616-a80c-d984b9020adc None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:54.084747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4c956-e78d-4d65-8773-6ccb1728d468 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:54.140598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62941f-81a1-4e54-9e6f-0da67840fbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:54.141418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62941f-81a1-4e54-9e6f-0da67840fbd3 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:54.141697 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62941f-81a1-4e54-9e6f-0da67840fbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:54.142551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62941f-81a1-4e54-9e6f-0da67840fbd3 None admin] PATH_INFO: `/v3/services/network` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:54.143283 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62941f-81a1-4e54-9e6f-0da67840fbd3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:54.145011 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62941f-81a1-4e54-9e6f-0da67840fbd3 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-4c62941f-81a1-4e54-9e6f-0da67840fbd3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:54.161058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:54.162130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:54.162130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:54.162130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:54.162130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:54.162130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:54.162130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:54.162130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:56:54.162130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:56:54.162130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:56:54.162130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:56:54.162130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:54.162130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:54.162130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:54.162130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:54.162130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:54.162130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:54.163046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:54.163046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:54.163046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:54.163046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:54.163046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:54.163046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:54.163046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:54.163046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:54.163046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:54.163046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:54.163046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:56:54.163046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:56:54.163046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:56:54.163046 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:54.174148 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 334/664] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:53 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:54.175638 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62941f-81a1-4e54-9e6f-0da67840fbd3 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:54.201245 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29effb84-682f-4616-a80c-d984b9020adc None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:54.258739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e36d9b-e86f-444d-bad4-87019b5fde29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:54.259544 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e36d9b-e86f-444d-bad4-87019b5fde29 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:54.261013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e36d9b-e86f-444d-bad4-87019b5fde29 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:54.261477 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e36d9b-e86f-444d-bad4-87019b5fde29 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:54.262275 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e36d9b-e86f-444d-bad4-87019b5fde29 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:54.262682 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e36d9b-e86f-444d-bad4-87019b5fde29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:54.264190 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e36d9b-e86f-444d-bad4-87019b5fde29 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:54.273463 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 331/665] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Jul 11 11:56:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:54.274832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e36d9b-e86f-444d-bad4-87019b5fde29 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:54.285385 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:54.312458 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62941f-81a1-4e54-9e6f-0da67840fbd3 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:54.350483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:54.361915 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67224c4f-2817-4307-bf14-93b0f64879d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:54.362579 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67224c4f-2817-4307-bf14-93b0f64879d0 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:54.362894 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67224c4f-2817-4307-bf14-93b0f64879d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:54.363170 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67224c4f-2817-4307-bf14-93b0f64879d0 None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:54.363868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67224c4f-2817-4307-bf14-93b0f64879d0 None admin] RBAC: Adding query filter params (name=network) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:54.364231 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67224c4f-2817-4307-bf14-93b0f64879d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:54.365656 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67224c4f-2817-4307-bf14-93b0f64879d0 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:54.374940 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 335/666] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Jul 11 11:56:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:54.376794 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67224c4f-2817-4307-bf14-93b0f64879d0 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:54.398154 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e36d9b-e86f-444d-bad4-87019b5fde29 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:54.448655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cf439-05fa-44af-ac0a-d12491631c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:54.449862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cf439-05fa-44af-ac0a-d12491631c8c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:54.450354 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cf439-05fa-44af-ac0a-d12491631c8c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:54.450832 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cf439-05fa-44af-ac0a-d12491631c8c None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:54.451961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cf439-05fa-44af-ac0a-d12491631c8c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:54.452448 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cf439-05fa-44af-ac0a-d12491631c8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:54.454915 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cf439-05fa-44af-ac0a-d12491631c8c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:54.461351 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 332/667] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Jul 11 11:56:54 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:54.493119 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67224c4f-2817-4307-bf14-93b0f64879d0 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:54.535003 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8f0a9-aa3e-408b-9a31-4e2cc350f331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:54.535791 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8f0a9-aa3e-408b-9a31-4e2cc350f331 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:54.536022 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8f0a9-aa3e-408b-9a31-4e2cc350f331 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:54.536301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8f0a9-aa3e-408b-9a31-4e2cc350f331 None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:54.537030 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8f0a9-aa3e-408b-9a31-4e2cc350f331 None admin] RBAC: Adding query filter params (type=network) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:54.537339 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8f0a9-aa3e-408b-9a31-4e2cc350f331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:54.538971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8f0a9-aa3e-408b-9a31-4e2cc350f331 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:54.546163 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 336/668] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Jul 11 11:56:54 2022] GET /identity/v3/services?type=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:56:55.698356 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fe6f8-f2a2-4f00-95f1-911afd1df379 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:55.698910 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fe6f8-f2a2-4f00-95f1-911afd1df379 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:55.699272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fe6f8-f2a2-4f00-95f1-911afd1df379 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:55.700688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 333/669] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:55.711508 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064409a-6c19-4be6-b6be-725ba9dd0a7e None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:55.712492 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064409a-6c19-4be6-b6be-725ba9dd0a7e None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:55.713507 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064409a-6c19-4be6-b6be-725ba9dd0a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:55.733698 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-2064409a-6c19-4be6-b6be-725ba9dd0a7e None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:55.735276 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-2064409a-6c19-4be6-b6be-725ba9dd0a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:55.813859 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:55.839166 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 337/670] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:55.857659 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fe6f8-f2a2-4f00-95f1-911afd1df379 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:55.965439 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:56.004636 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fe6f8-f2a2-4f00-95f1-911afd1df379 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:56.040931 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d235e63-2eae-42bd-bd81-2d631c17f655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:56.041993 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d235e63-2eae-42bd-bd81-2d631c17f655 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:56.042278 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d235e63-2eae-42bd-bd81-2d631c17f655 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:56.042553 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d235e63-2eae-42bd-bd81-2d631c17f655 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:56.043559 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d235e63-2eae-42bd-bd81-2d631c17f655 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:56.044908 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d235e63-2eae-42bd-bd81-2d631c17f655 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:56.071270 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 334/671] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Jul 11 11:56:55 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:56:56.434151 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523ad7e-183f-4696-8b78-a8735a9999b3 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:56.434151 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523ad7e-183f-4696-8b78-a8735a9999b3 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:56.434151 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523ad7e-183f-4696-8b78-a8735a9999b3 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:56.434918 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 338/672] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:56.440707 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a4fdd-68c1-4659-b92f-7e55e0c3dab1 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:56.441239 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a4fdd-68c1-4659-b92f-7e55e0c3dab1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:56.441714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a4fdd-68c1-4659-b92f-7e55e0c3dab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:56.459702 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-e86a4fdd-68c1-4659-b92f-7e55e0c3dab1 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:56.461260 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e86a4fdd-68c1-4659-b92f-7e55e0c3dab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:56.550685 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 335/673] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:56 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 11:56:56.574965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523ad7e-183f-4696-8b78-a8735a9999b3 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:56.681106 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523ad7e-183f-4696-8b78-a8735a9999b3 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:56.717998 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525ca5c-86fc-454d-ae77-e0e324191016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:56.718862 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525ca5c-86fc-454d-ae77-e0e324191016 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:56.719145 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525ca5c-86fc-454d-ae77-e0e324191016 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:56.719413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525ca5c-86fc-454d-ae77-e0e324191016 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:56.737818 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525ca5c-86fc-454d-ae77-e0e324191016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:56:56.746651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-e525ca5c-86fc-454d-ae77-e0e324191016 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:56:56.746651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:56.746651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:56.746651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:56.746651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:56.746651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:56.746651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:56.746651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:56.746651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:56.746651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:56.746651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:56.746651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:56.746651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:56:56.746651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:56:56.746651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:56:56.746651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:56:56.747678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:56:56.747678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:56:56.747678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:56:56.747678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:56:56.747678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:56.747678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:56.747678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:56.747678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:56.747678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:56.747678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:56.747678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:56.747678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:56.747678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:56.747678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:56.747678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:56.747678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:56.748499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:56.748499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:56.748499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:56.748499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:56.748499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:56:56.748499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:56:56.748499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:56:56.748499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:56:56.748499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:56:56.748499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:56:56.748499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:56:56.748499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:56.748499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 339/674] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:56:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:56.755791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a4fdd-68c1-4659-b92f-7e55e0c3dab1 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:56.823465 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:56.875709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a4fdd-68c1-4659-b92f-7e55e0c3dab1 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:56.898748 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cad50e-a24e-42cc-9392-69a9e4cae55c None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:56.899077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cad50e-a24e-42cc-9392-69a9e4cae55c None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:56.899460 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cad50e-a24e-42cc-9392-69a9e4cae55c None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:56.901876 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 340/675] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:56:56.908079 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ae70a-6e51-4ef8-af30-b538c9cac5ed None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:56.908362 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ae70a-6e51-4ef8-af30-b538c9cac5ed None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:56.908634 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ae70a-6e51-4ef8-af30-b538c9cac5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:56.920527 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5504d98-8582-453c-89f6-42b15caf20a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:56.921198 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5504d98-8582-453c-89f6-42b15caf20a0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:56.921643 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5504d98-8582-453c-89f6-42b15caf20a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:56.921915 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5504d98-8582-453c-89f6-42b15caf20a0 None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:56.922740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5504d98-8582-453c-89f6-42b15caf20a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:56.923058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5504d98-8582-453c-89f6-42b15caf20a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:56.924637 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5504d98-8582-453c-89f6-42b15caf20a0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:56.935434 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 336/676] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:56:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:56.940872 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5504d98-8582-453c-89f6-42b15caf20a0 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:57.052161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-8d7ae70a-6e51-4ef8-af30-b538c9cac5ed None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:57.053356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-8d7ae70a-6e51-4ef8-af30-b538c9cac5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:57.053533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5504d98-8582-453c-89f6-42b15caf20a0 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:57.072027 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:57.091294 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00a06b-9422-4edd-b794-b46f485a2854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:57.092083 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a06b-9422-4edd-b794-b46f485a2854 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:57.092369 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a06b-9422-4edd-b794-b46f485a2854 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:57.092647 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a06b-9422-4edd-b794-b46f485a2854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:57.097714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:57.105999 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00a06b-9422-4edd-b794-b46f485a2854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:57.107521 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00a06b-9422-4edd-b794-b46f485a2854 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:57.125609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-7b00a06b-9422-4edd-b794-b46f485a2854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:57.125609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:57.125609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:57.125609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:57.125609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:57.125609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:57.125609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:57.125609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:57.125609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:57.125609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:57.125609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:57.125609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:57.125609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:57.125609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:57.125609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:57.126500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:57.127443 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:57.127443 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:57.127443 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:57.127443 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:56:57.127669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 341/677] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:56 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:57.127669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719dbec-8dbd-45cc-a037-478c086a18f1 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:57.128298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719dbec-8dbd-45cc-a037-478c086a18f1 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:57.128298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719dbec-8dbd-45cc-a037-478c086a18f1 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:57.129566 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 342/678] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:57.134622 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55436b2-7b52-404e-9174-dd21465254fb None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:57.134945 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 337/679] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:57.135044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55436b2-7b52-404e-9174-dd21465254fb None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:57.138910 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55436b2-7b52-404e-9174-dd21465254fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:57.140748 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00a06b-9422-4edd-b794-b46f485a2854 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:57.161549 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-e55436b2-7b52-404e-9174-dd21465254fb None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:57.162786 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-e55436b2-7b52-404e-9174-dd21465254fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:57.233268 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 343/680] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:57 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 11:56:57.234365 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55436b2-7b52-404e-9174-dd21465254fb None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:57.269025 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00a06b-9422-4edd-b794-b46f485a2854 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:57.304933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88e516-0b94-4e0a-9a13-4e74d6f6388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:57.305504 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88e516-0b94-4e0a-9a13-4e74d6f6388f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:57.305809 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88e516-0b94-4e0a-9a13-4e74d6f6388f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:57.306057 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88e516-0b94-4e0a-9a13-4e74d6f6388f None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:57.307179 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88e516-0b94-4e0a-9a13-4e74d6f6388f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:57.307411 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88e516-0b94-4e0a-9a13-4e74d6f6388f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:57.308747 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88e516-0b94-4e0a-9a13-4e74d6f6388f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:57.320782 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 338/681] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:57.321565 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88e516-0b94-4e0a-9a13-4e74d6f6388f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:57.349234 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55436b2-7b52-404e-9174-dd21465254fb None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:57.356606 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:57.358557 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:57.386666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e000dea-d464-4f2f-9526-f960eb39c317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:57.387368 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e000dea-d464-4f2f-9526-f960eb39c317 None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:57.387654 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e000dea-d464-4f2f-9526-f960eb39c317 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:57.387924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e000dea-d464-4f2f-9526-f960eb39c317 None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:57.388645 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e000dea-d464-4f2f-9526-f960eb39c317 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:57.390020 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e000dea-d464-4f2f-9526-f960eb39c317 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:57.414739 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 344/682] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Jul 11 11:56:57 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:56:57.414739 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e000dea-d464-4f2f-9526-f960eb39c317 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:57.442131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88e516-0b94-4e0a-9a13-4e74d6f6388f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:57.490848 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eba7c-984a-4750-927c-ceaa1478b332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:57.491580 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eba7c-984a-4750-927c-ceaa1478b332 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:57.491870 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eba7c-984a-4750-927c-ceaa1478b332 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:57.492150 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eba7c-984a-4750-927c-ceaa1478b332 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:57.492886 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eba7c-984a-4750-927c-ceaa1478b332 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:57.494586 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eba7c-984a-4750-927c-ceaa1478b332 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:57.519455 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 339/683] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Jul 11 11:56:57 2022] POST /identity/v3/services => generated 240 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:56:57.597489 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e000dea-d464-4f2f-9526-f960eb39c317 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:57.651726 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523a44c-c92a-41c7-8f4e-82439fc15479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:57.652424 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523a44c-c92a-41c7-8f4e-82439fc15479 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:57.652707 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523a44c-c92a-41c7-8f4e-82439fc15479 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:57.652977 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523a44c-c92a-41c7-8f4e-82439fc15479 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:57.661834 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523a44c-c92a-41c7-8f4e-82439fc15479 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:57.663450 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523a44c-c92a-41c7-8f4e-82439fc15479 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:57.679590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-8523a44c-c92a-41c7-8f4e-82439fc15479 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:56:57.679590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:57.679590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:57.679590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:57.679590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:57.679590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:57.679590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:57.679590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:57.679590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:57.679590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:57.679590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:57.679590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:57.679590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:56:57.679590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:56:57.679590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:56:57.679590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:57.680576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:57.682324 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:57.682324 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:57.682324 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:56:57.682324 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:56:57.682324 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:56:57.682324 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:56:57.682324 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:56:57.682324 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:56:57.682324 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:56:57.682324 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:57.682324 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 345/684] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Jul 11 11:56:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:57.687301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eba7c-984a-4750-927c-ceaa1478b332 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:57.785935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:57.802021 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eba7c-984a-4750-927c-ceaa1478b332 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:57.840925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8475de-db41-4d8f-889f-e16e5b389cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:57.841603 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8475de-db41-4d8f-889f-e16e5b389cd1 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:57.841927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8475de-db41-4d8f-889f-e16e5b389cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:57.842203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8475de-db41-4d8f-889f-e16e5b389cd1 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:57.843071 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8475de-db41-4d8f-889f-e16e5b389cd1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:57.843383 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8475de-db41-4d8f-889f-e16e5b389cd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:57.844818 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8475de-db41-4d8f-889f-e16e5b389cd1 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:57.863815 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 340/685] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Jul 11 11:56:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:57.869675 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523a44c-c92a-41c7-8f4e-82439fc15479 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:57.902749 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:57.981716 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523a44c-c92a-41c7-8f4e-82439fc15479 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:58.019032 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badfcde-7622-4fce-b9d1-00753854c178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:58.019826 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badfcde-7622-4fce-b9d1-00753854c178 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:58.020106 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badfcde-7622-4fce-b9d1-00753854c178 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:58.020377 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badfcde-7622-4fce-b9d1-00753854c178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:58.031576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badfcde-7622-4fce-b9d1-00753854c178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:58.033144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badfcde-7622-4fce-b9d1-00753854c178 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:58.052646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-4badfcde-7622-4fce-b9d1-00753854c178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:58.052646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:58.052646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:58.052646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:58.052646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:58.052646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:58.052646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:58.052646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:58.052646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:58.052646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:58.052646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:58.052646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:58.052646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:56:58.052646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:56:58.052646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:58.053602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:58.054482 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:56:58.054482 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:56:58.054482 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:56:58.054482 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:58.054482 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 346/686] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:58.061528 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8475de-db41-4d8f-889f-e16e5b389cd1 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:58.172673 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8475de-db41-4d8f-889f-e16e5b389cd1 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:58.208492 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e49ad0-1299-47a8-b35a-f309368e0e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:58.209230 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e49ad0-1299-47a8-b35a-f309368e0e38 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:58.209519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e49ad0-1299-47a8-b35a-f309368e0e38 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:58.209793 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e49ad0-1299-47a8-b35a-f309368e0e38 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:58.210513 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e49ad0-1299-47a8-b35a-f309368e0e38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:58.210848 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e49ad0-1299-47a8-b35a-f309368e0e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:58.212239 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e49ad0-1299-47a8-b35a-f309368e0e38 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:58.224813 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 341/687] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:58.231043 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badfcde-7622-4fce-b9d1-00753854c178 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:58.312575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:58.339329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badfcde-7622-4fce-b9d1-00753854c178 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:58.380347 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01779a4a-87a1-426b-babb-2242883dc803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:58.381200 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779a4a-87a1-426b-babb-2242883dc803 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:58.381491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779a4a-87a1-426b-babb-2242883dc803 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:58.381767 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779a4a-87a1-426b-babb-2242883dc803 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:58.389260 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01779a4a-87a1-426b-babb-2242883dc803 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:58.390740 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01779a4a-87a1-426b-babb-2242883dc803 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:58.406298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-01779a4a-87a1-426b-babb-2242883dc803 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:58.406298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:58.406298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:58.406298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:58.406298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:58.406298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:58.406298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:58.406298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:58.406298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:58.406298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:58.406298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:58.406298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:58.406298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:56:58.406298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:56:58.406298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:58.407301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:58.408178 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:56:58.408178 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:56:58.408178 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:56:58.408178 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:56:58.408178 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:56:58.408178 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:56:58.408178 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:56:58.408178 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:58.408178 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 347/688] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:56:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:56:58.416491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e49ad0-1299-47a8-b35a-f309368e0e38 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:58.422252 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:58.528024 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e49ad0-1299-47a8-b35a-f309368e0e38 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:58.563798 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ad0ed-fa88-45a5-ae6e-d4c4803d720f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:58.564457 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ad0ed-fa88-45a5-ae6e-d4c4803d720f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:58.564738 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ad0ed-fa88-45a5-ae6e-d4c4803d720f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:58.565012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ad0ed-fa88-45a5-ae6e-d4c4803d720f None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:58.565783 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ad0ed-fa88-45a5-ae6e-d4c4803d720f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:58.566094 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ad0ed-fa88-45a5-ae6e-d4c4803d720f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:58.567582 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ad0ed-fa88-45a5-ae6e-d4c4803d720f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:58.574814 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9799e2-ec53-427e-874c-5e4a53068661 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:58.575105 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9799e2-ec53-427e-874c-5e4a53068661 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:58.575383 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9799e2-ec53-427e-874c-5e4a53068661 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:58.577651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 348/689] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:58.582269 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 342/690] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:56:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:58.586961 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ddf81-1a8c-4e6b-abd0-f76e7c3f4844 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:58.587247 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ddf81-1a8c-4e6b-abd0-f76e7c3f4844 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:58.587520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ddf81-1a8c-4e6b-abd0-f76e7c3f4844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:58.588242 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ad0ed-fa88-45a5-ae6e-d4c4803d720f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:58.605114 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-f02ddf81-1a8c-4e6b-abd0-f76e7c3f4844 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:58.606338 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-f02ddf81-1a8c-4e6b-abd0-f76e7c3f4844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:58.666069 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:58.698858 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 349/691] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:58 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:56:58.718317 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ad0ed-fa88-45a5-ae6e-d4c4803d720f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:58.723432 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ddf81-1a8c-4e6b-abd0-f76e7c3f4844 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:58.767901 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117acd2d-363a-4dc6-82c8-c084cd0a5a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:58.768801 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117acd2d-363a-4dc6-82c8-c084cd0a5a68 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:58.769086 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117acd2d-363a-4dc6-82c8-c084cd0a5a68 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:58.769362 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117acd2d-363a-4dc6-82c8-c084cd0a5a68 None admin] PATH_INFO: `/v3/projects/6e452080fec045788d9bd5dfdb7a3c52/users/11550a0ca11041b0b9b175860f2b6633/roles/11fc9dc7c3664b2b8af8eee2462707b8` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:58.772879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117acd2d-363a-4dc6-82c8-c084cd0a5a68 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e452080fec045788d9bd5dfdb7a3c52, user_id=11550a0ca11041b0b9b175860f2b6633, role_id=11fc9dc7c3664b2b8af8eee2462707b8)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:58.774340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117acd2d-363a-4dc6-82c8-c084cd0a5a68 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:58.801318 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 343/692] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Jul 11 11:56:58 2022] PUT /identity/v3/projects/6e452080fec045788d9bd5dfdb7a3c52/users/11550a0ca11041b0b9b175860f2b6633/roles/11fc9dc7c3664b2b8af8eee2462707b8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:56:58.812930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:58.864381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ddf81-1a8c-4e6b-abd0-f76e7c3f4844 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:58.906160 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679752-ed10-48c7-8557-1caca39a7881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:58.907727 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679752-ed10-48c7-8557-1caca39a7881 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:58.908155 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679752-ed10-48c7-8557-1caca39a7881 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:58.908571 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679752-ed10-48c7-8557-1caca39a7881 None admin] PATH_INFO: `/v3/services/image` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:58.909378 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c679752-ed10-48c7-8557-1caca39a7881 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:58.911019 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c679752-ed10-48c7-8557-1caca39a7881 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-5c679752-ed10-48c7-8557-1caca39a7881 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:56:58.923999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:56:58.925305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:56:58.925305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:56:58.925305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:56:58.925305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:56:58.925305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:56:58.925305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:56:58.925305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:56:58.925305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:56:58.925305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:56:58.925305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:56:58.925305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:56:58.925305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:56:58.925305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:56:58.925305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:56:58.925305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:56:58.925305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:56:58.926318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:56:58.926318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:56:58.926318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:56:58.926318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:56:58.926318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:56:58.926318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:56:58.926318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:56:58.926318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:56:58.926318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:56:58.926318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:56:58.926318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:56:58.926318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:56:58.926318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:56:58.926318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:56:58.929061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 350/693] 10.222.0.25 () {56 vars in 1105 bytes} [Mon Jul 11 11:56:58 2022] GET /identity/v3/services/image => generated 86 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:56:58.935368 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117acd2d-363a-4dc6-82c8-c084cd0a5a68 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:59.044151 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117acd2d-363a-4dc6-82c8-c084cd0a5a68 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:59.069367 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:59.081613 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38b842-bb02-4b5d-80d8-d321389bfe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:59.082274 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38b842-bb02-4b5d-80d8-d321389bfe74 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:59.082561 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38b842-bb02-4b5d-80d8-d321389bfe74 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:59.082859 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38b842-bb02-4b5d-80d8-d321389bfe74 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:59.083602 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38b842-bb02-4b5d-80d8-d321389bfe74 None admin] RBAC: Adding query filter params (name=image) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:59.084234 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38b842-bb02-4b5d-80d8-d321389bfe74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:59.086033 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38b842-bb02-4b5d-80d8-d321389bfe74 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:59.091496 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 344/694] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:59.097286 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679752-ed10-48c7-8557-1caca39a7881 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:59.216524 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679752-ed10-48c7-8557-1caca39a7881 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:59.244766 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:59.253902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd37590-5e47-4f7f-a565-d8a343eb18ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:59.254575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd37590-5e47-4f7f-a565-d8a343eb18ce None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:59.254884 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd37590-5e47-4f7f-a565-d8a343eb18ce None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:59.255203 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd37590-5e47-4f7f-a565-d8a343eb18ce None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:59.255903 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd37590-5e47-4f7f-a565-d8a343eb18ce None admin] RBAC: Adding query filter params (type=image) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:59.256204 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd37590-5e47-4f7f-a565-d8a343eb18ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:59.257568 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd37590-5e47-4f7f-a565-d8a343eb18ce None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:59.262932 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 351/695] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:56:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:59.268591 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38b842-bb02-4b5d-80d8-d321389bfe74 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:59.381562 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38b842-bb02-4b5d-80d8-d321389bfe74 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:59.422668 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c808f5-771d-4315-93a3-2ac696d21112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:59.423369 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c808f5-771d-4315-93a3-2ac696d21112 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:59.423648 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c808f5-771d-4315-93a3-2ac696d21112 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:59.423919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c808f5-771d-4315-93a3-2ac696d21112 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:59.424703 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c808f5-771d-4315-93a3-2ac696d21112 None admin] RBAC: Adding query filter params (interface=public, service_id=a769157eb3aa4aceb12fb1c09132177e, region_id=RegionOne) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:56:59.425005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c808f5-771d-4315-93a3-2ac696d21112 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:59.426377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c808f5-771d-4315-93a3-2ac696d21112 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:59.435424 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 345/696] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Jul 11 11:56:59 2022] GET /identity/v3/endpoints?service_id=a769157eb3aa4aceb12fb1c09132177e&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:56:59.440866 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd37590-5e47-4f7f-a565-d8a343eb18ce None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:56:59.552061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd37590-5e47-4f7f-a565-d8a343eb18ce None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:56:59.588783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbe2c5-9e63-49bc-82fa-6572349b160c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:56:59.589448 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbe2c5-9e63-49bc-82fa-6572349b160c None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:59.589729 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbe2c5-9e63-49bc-82fa-6572349b160c None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:59.590000 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbe2c5-9e63-49bc-82fa-6572349b160c None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:59.590672 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbe2c5-9e63-49bc-82fa-6572349b160c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:56:59.592067 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbe2c5-9e63-49bc-82fa-6572349b160c None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:56:59.597929 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 352/697] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Jul 11 11:56:59 2022] GET /identity/v3/services => generated 1002 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:56:59.854607 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2379a6-f467-4f8c-8b6e-138156cd7c80 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:59.855157 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2379a6-f467-4f8c-8b6e-138156cd7c80 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:59.855507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2379a6-f467-4f8c-8b6e-138156cd7c80 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:59.857268 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 346/698] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:59.862491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b58a37-f124-41a1-9176-d24c28aa2460 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:59.862930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b58a37-f124-41a1-9176-d24c28aa2460 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:59.863302 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b58a37-f124-41a1-9176-d24c28aa2460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:59.880433 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-26b58a37-f124-41a1-9176-d24c28aa2460 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:59.881665 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-26b58a37-f124-41a1-9176-d24c28aa2460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:59.934855 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:56:59.943379 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f46c6-1e27-4af7-8db0-1d2a833218de None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:59.943671 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f46c6-1e27-4af7-8db0-1d2a833218de None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:59.943945 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f46c6-1e27-4af7-8db0-1d2a833218de None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:59.945561 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 347/699] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:56:59.951411 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba5b32-2e89-435e-9b0a-f14948ad0fe5 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:56:59.951701 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba5b32-2e89-435e-9b0a-f14948ad0fe5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:56:59.951978 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba5b32-2e89-435e-9b0a-f14948ad0fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:56:59.959667 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 353/700] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:59 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:56:59.969043 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-36ba5b32-2e89-435e-9b0a-f14948ad0fe5 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:56:59.970526 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-36ba5b32-2e89-435e-9b0a-f14948ad0fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:56:59.983188 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b58a37-f124-41a1-9176-d24c28aa2460 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:00.025433 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:00.054739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 348/701] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:56:59 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:57:00.081208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba5b32-2e89-435e-9b0a-f14948ad0fe5 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:00.096527 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b58a37-f124-41a1-9176-d24c28aa2460 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:00.133176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac39ab-bcea-4cdf-b196-4d955719a797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:00.133899 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac39ab-bcea-4cdf-b196-4d955719a797 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:00.134180 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac39ab-bcea-4cdf-b196-4d955719a797 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:00.134505 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac39ab-bcea-4cdf-b196-4d955719a797 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:00.135751 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac39ab-bcea-4cdf-b196-4d955719a797 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:00.137191 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac39ab-bcea-4cdf-b196-4d955719a797 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:00.150225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-3dac39ab-bcea-4cdf-b196-4d955719a797 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:57:00.150225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:00.150225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:57:00.150225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:57:00.150225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:57:00.150225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:57:00.150225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:57:00.150225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:00.150225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:57:00.150225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:00.150225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:00.150225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:00.150225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:00.150225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:00.150225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:00.150225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:00.151251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:00.151251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:00.151251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:00.151251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:00.151251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:00.151251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:00.151251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:00.151251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:57:00.151251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:57:00.151251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:57:00.151251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:57:00.151251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:00.151251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:00.151251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:00.151251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:00.151251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:00.152099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:00.152099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:00.152099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:00.152099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:00.152099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:00.152099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:00.152099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:00.152099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:00.152099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:00.152099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:00.152099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:00.152099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:57:00.152099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:00.152099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:57:00.152099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:00.152099 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 354/702] 10.222.0.25 () {56 vars in 1129 bytes} [Mon Jul 11 11:56:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:57:00.157192 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac39ab-bcea-4cdf-b196-4d955719a797 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:00.225753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:00.229851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba5b32-2e89-435e-9b0a-f14948ad0fe5 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:00.275828 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2da8e-2107-46e3-98f1-87133aae75ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:00.277218 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2da8e-2107-46e3-98f1-87133aae75ab None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:00.277740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2da8e-2107-46e3-98f1-87133aae75ab None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:00.278224 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2da8e-2107-46e3-98f1-87133aae75ab None admin] PATH_INFO: `/v3/services/network` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:00.279115 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2da8e-2107-46e3-98f1-87133aae75ab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:00.280833 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2da8e-2107-46e3-98f1-87133aae75ab None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:00.286124 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac39ab-bcea-4cdf-b196-4d955719a797 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-d7d2da8e-2107-46e3-98f1-87133aae75ab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:00.293715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:00.294663 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:00.294663 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:00.294663 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:00.294663 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:00.294663 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:00.294663 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:00.294663 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:57:00.294663 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:57:00.294663 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:57:00.294663 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:57:00.294663 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:00.294663 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:00.294663 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:00.294663 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:00.294663 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:00.294663 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:00.295780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:00.295780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:00.295780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:00.295780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:00.295780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:00.295780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:00.295780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:00.295780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:00.295780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:00.295780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:00.295780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:57:00.295780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:00.295780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:57:00.295780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:00.298446 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 349/703] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:57:00 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:57:00.304509 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2da8e-2107-46e3-98f1-87133aae75ab None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:00.321390 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27889a7e-ad4f-446c-aab1-91233c6b9648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:00.322774 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27889a7e-ad4f-446c-aab1-91233c6b9648 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:00.323071 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27889a7e-ad4f-446c-aab1-91233c6b9648 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:00.323352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27889a7e-ad4f-446c-aab1-91233c6b9648 None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:00.324198 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27889a7e-ad4f-446c-aab1-91233c6b9648 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:00.324507 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27889a7e-ad4f-446c-aab1-91233c6b9648 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:00.325910 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27889a7e-ad4f-446c-aab1-91233c6b9648 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:00.331754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 355/704] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Jul 11 11:57:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:00.339892 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27889a7e-ad4f-446c-aab1-91233c6b9648 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:00.453586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27889a7e-ad4f-446c-aab1-91233c6b9648 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:00.469100 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:00.487281 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:00.499142 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ba97e-feb9-44bf-80b2-b93b507d7f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:00.499935 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba97e-feb9-44bf-80b2-b93b507d7f4f None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:00.500316 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba97e-feb9-44bf-80b2-b93b507d7f4f None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:00.500689 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba97e-feb9-44bf-80b2-b93b507d7f4f None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:00.501488 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ba97e-feb9-44bf-80b2-b93b507d7f4f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:00.501887 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ba97e-feb9-44bf-80b2-b93b507d7f4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:00.503471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ba97e-feb9-44bf-80b2-b93b507d7f4f None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:00.509322 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 356/705] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Jul 11 11:57:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:00.518169 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ba97e-feb9-44bf-80b2-b93b507d7f4f None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:00.566296 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2da8e-2107-46e3-98f1-87133aae75ab None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:00.615394 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667d1c5-e9c7-4aef-aca7-444c044655f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:00.616052 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667d1c5-e9c7-4aef-aca7-444c044655f5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:00.616330 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667d1c5-e9c7-4aef-aca7-444c044655f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:00.616601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667d1c5-e9c7-4aef-aca7-444c044655f5 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:00.617295 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667d1c5-e9c7-4aef-aca7-444c044655f5 None admin] RBAC: Adding query filter params (name=network) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:00.617596 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667d1c5-e9c7-4aef-aca7-444c044655f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:00.619592 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667d1c5-e9c7-4aef-aca7-444c044655f5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:00.629157 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 350/706] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Jul 11 11:57:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:00.630376 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667d1c5-e9c7-4aef-aca7-444c044655f5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:00.641811 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ba97e-feb9-44bf-80b2-b93b507d7f4f None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:00.678736 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4ff09-215b-4f97-8066-719f76b12692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:00.679468 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4ff09-215b-4f97-8066-719f76b12692 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:00.679703 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4ff09-215b-4f97-8066-719f76b12692 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:00.679972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4ff09-215b-4f97-8066-719f76b12692 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:00.680753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4ff09-215b-4f97-8066-719f76b12692 None admin] RBAC: Adding query filter params (interface=public, service_id=0dd0d6f2d3b04b00bc91bb49051ea1bf, region_id=RegionOne) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:00.681948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4ff09-215b-4f97-8066-719f76b12692 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:00.682922 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4ff09-215b-4f97-8066-719f76b12692 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:00.695303 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 357/707] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Jul 11 11:57:00 2022] GET /identity/v3/endpoints?service_id=0dd0d6f2d3b04b00bc91bb49051ea1bf&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:00.696601 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4ff09-215b-4f97-8066-719f76b12692 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:00.745060 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:00.770194 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667d1c5-e9c7-4aef-aca7-444c044655f5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:00.783246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:00.811172 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d18e8b-c354-4f8d-b567-35af7b543680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:00.811992 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d18e8b-c354-4f8d-b567-35af7b543680 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:00.812524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d18e8b-c354-4f8d-b567-35af7b543680 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:00.812632 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d18e8b-c354-4f8d-b567-35af7b543680 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:00.813484 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d18e8b-c354-4f8d-b567-35af7b543680 None admin] RBAC: Adding query filter params (type=network) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:00.813744 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d18e8b-c354-4f8d-b567-35af7b543680 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:00.815318 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d18e8b-c354-4f8d-b567-35af7b543680 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:00.826386 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 351/708] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Jul 11 11:57:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:00.826755 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4ff09-215b-4f97-8066-719f76b12692 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:00.828403 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d18e8b-c354-4f8d-b567-35af7b543680 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:00.872646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3ec33-3cb5-4dce-a243-3f48705e3dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:00.873437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3ec33-3cb5-4dce-a243-3f48705e3dfb None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:00.873787 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3ec33-3cb5-4dce-a243-3f48705e3dfb None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:00.874131 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3ec33-3cb5-4dce-a243-3f48705e3dfb None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:00.874907 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3ec33-3cb5-4dce-a243-3f48705e3dfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:00.877509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3ec33-3cb5-4dce-a243-3f48705e3dfb None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:00.884100 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 358/709] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Jul 11 11:57:00 2022] GET /identity/v3/services => generated 1002 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:57:00.957110 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d18e8b-c354-4f8d-b567-35af7b543680 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:00.998267 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa52f21-3139-41b9-abc9-08fb28611aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:00.999336 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa52f21-3139-41b9-abc9-08fb28611aa4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:00.999818 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa52f21-3139-41b9-abc9-08fb28611aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:01.000301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa52f21-3139-41b9-abc9-08fb28611aa4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:01.001309 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa52f21-3139-41b9-abc9-08fb28611aa4 None admin] RBAC: Adding query filter params (interface=public, service_id=59ff6ea8ec1643eda6f232e0df7c7264, region_id=RegionOne) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:01.001819 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa52f21-3139-41b9-abc9-08fb28611aa4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:01.003436 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa52f21-3139-41b9-abc9-08fb28611aa4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:01.010648 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 352/710] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Jul 11 11:57:00 2022] GET /identity/v3/endpoints?service_id=59ff6ea8ec1643eda6f232e0df7c7264&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:01.016645 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3ec33-3cb5-4dce-a243-3f48705e3dfb None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:01.131524 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3ec33-3cb5-4dce-a243-3f48705e3dfb None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:01.140280 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:01.169032 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928f3b6-d940-44f9-bc21-ceee52f68168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:01.170127 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928f3b6-d940-44f9-bc21-ceee52f68168 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:01.170417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928f3b6-d940-44f9-bc21-ceee52f68168 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:01.170692 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928f3b6-d940-44f9-bc21-ceee52f68168 None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:01.171392 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928f3b6-d940-44f9-bc21-ceee52f68168 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:01.172761 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928f3b6-d940-44f9-bc21-ceee52f68168 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:01.179679 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 359/711] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Jul 11 11:57:01 2022] GET /identity/v3/services => generated 1002 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:57:01.209507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13686b7c-e95e-45e4-94a7-c3ea408b1347 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:01.209846 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13686b7c-e95e-45e4-94a7-c3ea408b1347 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:01.210072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13686b7c-e95e-45e4-94a7-c3ea408b1347 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:01.212974 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 353/712] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:57:01.217708 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fc417-c265-4a7d-87c6-18b4e8576fc2 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:01.218060 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fc417-c265-4a7d-87c6-18b4e8576fc2 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:01.218343 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fc417-c265-4a7d-87c6-18b4e8576fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:01.237441 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-537fc417-c265-4a7d-87c6-18b4e8576fc2 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:01.238660 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-537fc417-c265-4a7d-87c6-18b4e8576fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:01.317056 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 360/713] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:01 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:57:01.341738 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13686b7c-e95e-45e4-94a7-c3ea408b1347 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:01.391002 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:01.456718 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13686b7c-e95e-45e4-94a7-c3ea408b1347 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:01.492856 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73406e2-37c5-46f3-ae76-701657761660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:01.493692 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73406e2-37c5-46f3-ae76-701657761660 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:01.494019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73406e2-37c5-46f3-ae76-701657761660 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:01.494290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73406e2-37c5-46f3-ae76-701657761660 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:01.505087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73406e2-37c5-46f3-ae76-701657761660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:57:01.513058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-e73406e2-37c5-46f3-ae76-701657761660 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:57:01.513058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:01.513058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:01.513058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:01.513058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:01.513058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:01.513058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:01.513058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:01.513058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:01.513058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:01.513058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:01.513058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:01.513058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:57:01.513058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:57:01.513058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:57:01.513058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:57:01.514011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:57:01.514011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:57:01.514011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:57:01.514011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:57:01.514011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:01.514011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:01.514011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:01.514011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:01.514011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:01.514011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:01.514011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:01.514011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:01.514011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:01.514011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:01.514011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:01.514011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:01.514862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:01.514862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:01.514862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:01.514862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:01.514862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:57:01.514862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:57:01.514862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:57:01.514862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:57:01.514862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:57:01.514862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:57:01.514862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:57:01.514862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:01.518848 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 354/714] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:57:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:57:01.520591 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fc417-c265-4a7d-87c6-18b4e8576fc2 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:01.624057 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:01.627717 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fc417-c265-4a7d-87c6-18b4e8576fc2 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:01.666657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9635c-9397-47e7-8c2a-b6bd0f8206a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:01.667349 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9635c-9397-47e7-8c2a-b6bd0f8206a3 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:01.667629 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9635c-9397-47e7-8c2a-b6bd0f8206a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:01.667902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9635c-9397-47e7-8c2a-b6bd0f8206a3 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:01.668637 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9635c-9397-47e7-8c2a-b6bd0f8206a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:01.668936 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9635c-9397-47e7-8c2a-b6bd0f8206a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:01.670305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9635c-9397-47e7-8c2a-b6bd0f8206a3 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:01.682839 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 361/715] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:57:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:01.685454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73406e2-37c5-46f3-ae76-701657761660 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:01.789440 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:01.794231 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73406e2-37c5-46f3-ae76-701657761660 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:01.829844 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168090c2-599e-482e-bc9b-d840b7abe9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:01.830651 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168090c2-599e-482e-bc9b-d840b7abe9e0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:01.830954 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168090c2-599e-482e-bc9b-d840b7abe9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:01.831225 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168090c2-599e-482e-bc9b-d840b7abe9e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:01.845415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168090c2-599e-482e-bc9b-d840b7abe9e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:01.846930 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168090c2-599e-482e-bc9b-d840b7abe9e0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:01.867474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-168090c2-599e-482e-bc9b-d840b7abe9e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:57:01.867474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:01.867474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:01.867474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:01.867474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:01.867474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:01.867474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:01.867474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:01.867474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:01.867474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:01.867474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:01.867474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:01.867474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:57:01.867474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:57:01.867474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:01.869805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:01.872068 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:57:01.872068 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:57:01.872068 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:57:01.872068 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:01.872068 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 355/716] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:57:01.878801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9635c-9397-47e7-8c2a-b6bd0f8206a3 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:01.985136 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9635c-9397-47e7-8c2a-b6bd0f8206a3 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:02.010768 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92448e3-8fad-453d-8051-1629c04a316f None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:02.010768 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92448e3-8fad-453d-8051-1629c04a316f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:02.010768 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92448e3-8fad-453d-8051-1629c04a316f None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:02.013026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 356/717] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:57:02.018382 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f2067-ebb3-4a82-a269-ab4b55d25c0e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:02.019020 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f2067-ebb3-4a82-a269-ab4b55d25c0e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:02.019522 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f2067-ebb3-4a82-a269-ab4b55d25c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:02.021891 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfef12-7ccf-4e15-9987-ba6ac9b3967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:02.022557 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfef12-7ccf-4e15-9987-ba6ac9b3967c None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:02.022879 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfef12-7ccf-4e15-9987-ba6ac9b3967c None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:02.023157 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfef12-7ccf-4e15-9987-ba6ac9b3967c None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:02.023884 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfef12-7ccf-4e15-9987-ba6ac9b3967c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:02.024193 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfef12-7ccf-4e15-9987-ba6ac9b3967c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:02.025887 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cfef12-7ccf-4e15-9987-ba6ac9b3967c None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:02.038791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-898f2067-ebb3-4a82-a269-ab4b55d25c0e None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:02.040008 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-898f2067-ebb3-4a82-a269-ab4b55d25c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:02.042459 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 362/718] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:02.049139 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfef12-7ccf-4e15-9987-ba6ac9b3967c None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:02.080139 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:02.127150 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 357/719] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:02 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:57:02.152581 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f2067-ebb3-4a82-a269-ab4b55d25c0e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:02.190578 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfef12-7ccf-4e15-9987-ba6ac9b3967c None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:02.231078 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe52b9-16a5-43fd-89d1-382a3874816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:02.232115 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe52b9-16a5-43fd-89d1-382a3874816f None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:02.232577 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe52b9-16a5-43fd-89d1-382a3874816f None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:02.233003 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe52b9-16a5-43fd-89d1-382a3874816f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:02.241283 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe52b9-16a5-43fd-89d1-382a3874816f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:02.243029 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe52b9-16a5-43fd-89d1-382a3874816f None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:02.260070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-7cfe52b9-16a5-43fd-89d1-382a3874816f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:57:02.260070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:02.260070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:02.260070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:02.260070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:02.260070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:02.260070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:02.260070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:02.260070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:02.260070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:02.260070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:02.260070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:02.260070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:57:02.260070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:57:02.260070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:57:02.260070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:02.262701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:02.263666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:02.263666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:02.263666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:57:02.263666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:57:02.263666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:57:02.263666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:57:02.263666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:57:02.263666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:57:02.263666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 11:57:02.263666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:02.266438 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 363/720] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Jul 11 11:57:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:57:02.269864 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:02.272456 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe52b9-16a5-43fd-89d1-382a3874816f None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:02.295793 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f2067-ebb3-4a82-a269-ab4b55d25c0e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:02.344157 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677a591-9d0d-4729-87d8-d0e753471878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:02.345271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677a591-9d0d-4729-87d8-d0e753471878 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:02.345740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677a591-9d0d-4729-87d8-d0e753471878 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:02.346396 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677a591-9d0d-4729-87d8-d0e753471878 None admin] PATH_INFO: `/v3/services/image` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:02.347856 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677a591-9d0d-4729-87d8-d0e753471878 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:02.349703 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677a591-9d0d-4729-87d8-d0e753471878 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:02.365029 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-c677a591-9d0d-4729-87d8-d0e753471878 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:02.367185 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:02.370415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:02.370415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:02.370415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:02.370415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:02.370415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:02.370415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:02.370415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:57:02.370415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:57:02.370415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:57:02.370415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:57:02.370415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:02.370415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:02.370415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:02.370415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:02.370415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:02.370415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:02.371569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:02.371569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:02.371569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:02.371569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:02.371569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:02.371569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:02.371569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:02.371569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:02.371569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:02.371569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:02.371569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:57:02.371569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:02.371569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 11:57:02.371569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:02.375186 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 358/721] 10.222.0.25 () {56 vars in 1105 bytes} [Mon Jul 11 11:57:02 2022] GET /identity/v3/services/image => generated 86 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:57:02.377576 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677a591-9d0d-4729-87d8-d0e753471878 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:02.394455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe52b9-16a5-43fd-89d1-382a3874816f None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:02.431004 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf9fed-5690-4823-8ca7-ac3ea4aae00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:02.432304 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf9fed-5690-4823-8ca7-ac3ea4aae00a None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:02.432597 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf9fed-5690-4823-8ca7-ac3ea4aae00a None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:02.432998 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf9fed-5690-4823-8ca7-ac3ea4aae00a None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:02.433833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf9fed-5690-4823-8ca7-ac3ea4aae00a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:02.434147 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf9fed-5690-4823-8ca7-ac3ea4aae00a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:02.435733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf9fed-5690-4823-8ca7-ac3ea4aae00a None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:02.462637 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 364/722] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Jul 11 11:57:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:02.464287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf9fed-5690-4823-8ca7-ac3ea4aae00a None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:02.496167 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677a591-9d0d-4729-87d8-d0e753471878 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:02.532546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0c883-8f83-4d9e-a920-a154fd72214a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:02.533571 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0c883-8f83-4d9e-a920-a154fd72214a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:02.534084 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0c883-8f83-4d9e-a920-a154fd72214a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:02.534565 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0c883-8f83-4d9e-a920-a154fd72214a None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:02.535543 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0c883-8f83-4d9e-a920-a154fd72214a None admin] RBAC: Adding query filter params (name=image) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:02.536053 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0c883-8f83-4d9e-a920-a154fd72214a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:02.537620 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0c883-8f83-4d9e-a920-a154fd72214a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:02.547925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 359/723] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:57:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:02.549102 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0c883-8f83-4d9e-a920-a154fd72214a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:02.562389 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:02.579336 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf9fed-5690-4823-8ca7-ac3ea4aae00a None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:02.617838 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8486909-2d3b-4efb-86f3-20cd4767da2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:02.619512 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8486909-2d3b-4efb-86f3-20cd4767da2e None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:02.620236 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8486909-2d3b-4efb-86f3-20cd4767da2e None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:02.620697 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8486909-2d3b-4efb-86f3-20cd4767da2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:02.633221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:02.660478 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0c883-8f83-4d9e-a920-a154fd72214a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:02.699184 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8486909-2d3b-4efb-86f3-20cd4767da2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:02.700997 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8486909-2d3b-4efb-86f3-20cd4767da2e None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:02.702594 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6ebc1-90b3-470e-8870-0119979df79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:02.703352 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6ebc1-90b3-470e-8870-0119979df79e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:02.703598 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6ebc1-90b3-470e-8870-0119979df79e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:02.703878 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6ebc1-90b3-470e-8870-0119979df79e None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:02.704582 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6ebc1-90b3-470e-8870-0119979df79e None admin] RBAC: Adding query filter params (type=image) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:02.704891 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6ebc1-90b3-470e-8870-0119979df79e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:02.706268 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6ebc1-90b3-470e-8870-0119979df79e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:02.716424 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 360/724] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:57:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:02.717272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6ebc1-90b3-470e-8870-0119979df79e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:02.791979 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:02.822372 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 365/725] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:57:02 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:57:02.824258 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8486909-2d3b-4efb-86f3-20cd4767da2e None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:02.825170 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6ebc1-90b3-470e-8870-0119979df79e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:02.861878 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b050307-031f-421a-82b8-f309c4869f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:02.862544 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b050307-031f-421a-82b8-f309c4869f7b None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:02.862862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b050307-031f-421a-82b8-f309c4869f7b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:02.863142 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b050307-031f-421a-82b8-f309c4869f7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:02.864005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b050307-031f-421a-82b8-f309c4869f7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:02.865679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b050307-031f-421a-82b8-f309c4869f7b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:02.873865 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:02.898882 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 361/726] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Jul 11 11:57:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:57:02.957228 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8486909-2d3b-4efb-86f3-20cd4767da2e None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:03.004052 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539badc4-4e81-4216-ae09-ecb46ba327c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:03.005260 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539badc4-4e81-4216-ae09-ecb46ba327c2 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:03.005790 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539badc4-4e81-4216-ae09-ecb46ba327c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:03.006287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539badc4-4e81-4216-ae09-ecb46ba327c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:03.018435 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539badc4-4e81-4216-ae09-ecb46ba327c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:03.020391 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539badc4-4e81-4216-ae09-ecb46ba327c2 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:03.042034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-539badc4-4e81-4216-ae09-ecb46ba327c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:57:03.042034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:03.042034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:03.042034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:03.042034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:03.042034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:03.042034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:03.042034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:03.042034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:03.042034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:03.042034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:03.042034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:03.042034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:57:03.042034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:57:03.042034 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:03.043562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:03.044445 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:57:03.044445 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:57:03.044445 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:57:03.044445 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:03.050853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 366/727] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:57:03.053001 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b050307-031f-421a-82b8-f309c4869f7b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:03.170351 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b050307-031f-421a-82b8-f309c4869f7b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:03.200587 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:03.209668 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c044533-e830-45d4-af41-5f632a959816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:03.210271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c044533-e830-45d4-af41-5f632a959816 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:03.210560 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c044533-e830-45d4-af41-5f632a959816 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:03.210885 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c044533-e830-45d4-af41-5f632a959816 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:03.211638 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c044533-e830-45d4-af41-5f632a959816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:03.211950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c044533-e830-45d4-af41-5f632a959816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:03.214073 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c044533-e830-45d4-af41-5f632a959816 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:03.229412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 362/728] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:03.235892 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539badc4-4e81-4216-ae09-ecb46ba327c2 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:03.337126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:03.367777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5809c-4e13-4c40-9093-629aebb0c771 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:03.368089 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5809c-4e13-4c40-9093-629aebb0c771 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:03.368372 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5809c-4e13-4c40-9093-629aebb0c771 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:03.368901 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539badc4-4e81-4216-ae09-ecb46ba327c2 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:03.370010 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 363/729] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:57:03.375445 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59213841-845e-44af-9a46-102a69098cfd None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:03.375699 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59213841-845e-44af-9a46-102a69098cfd None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:03.375984 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59213841-845e-44af-9a46-102a69098cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:03.414743 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-59213841-845e-44af-9a46-102a69098cfd None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:03.418396 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-59213841-845e-44af-9a46-102a69098cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:03.432120 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109a9ea-aaef-4f29-9ed0-5e0325fc5623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:03.434144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109a9ea-aaef-4f29-9ed0-5e0325fc5623 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:03.434144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109a9ea-aaef-4f29-9ed0-5e0325fc5623 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:03.434144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109a9ea-aaef-4f29-9ed0-5e0325fc5623 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:03.445591 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109a9ea-aaef-4f29-9ed0-5e0325fc5623 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:03.445591 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109a9ea-aaef-4f29-9ed0-5e0325fc5623 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:03.475602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-f109a9ea-aaef-4f29-9ed0-5e0325fc5623 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:57:03.475602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:03.475602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:03.475602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:03.475602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:03.475602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:03.475602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:03.475602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:03.475602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:03.475602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:03.475602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:03.475602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:03.475602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:57:03.475602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:57:03.475602 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:03.476520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:03.477407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:57:03.477407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:57:03.477407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:57:03.477407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:57:03.477407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:57:03.477407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:57:03.477407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:57:03.477407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:03.482797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 367/730] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:57:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:57:03.484105 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109a9ea-aaef-4f29-9ed0-5e0325fc5623 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:03.535979 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 364/731] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:03 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:57:03.560622 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59213841-845e-44af-9a46-102a69098cfd None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:03.652927 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109a9ea-aaef-4f29-9ed0-5e0325fc5623 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:03.687457 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a43c9-bc68-4f20-a53e-beae8b6ccaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:03.688125 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a43c9-bc68-4f20-a53e-beae8b6ccaa6 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:03.688422 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a43c9-bc68-4f20-a53e-beae8b6ccaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:03.688688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a43c9-bc68-4f20-a53e-beae8b6ccaa6 None admin] PATH_INFO: `/v3/projects` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:03.689468 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a43c9-bc68-4f20-a53e-beae8b6ccaa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:03.689778 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a43c9-bc68-4f20-a53e-beae8b6ccaa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:03.691254 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a43c9-bc68-4f20-a53e-beae8b6ccaa6 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:03.699583 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59213841-845e-44af-9a46-102a69098cfd None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:03.704508 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 368/732] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:57:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:03.705976 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa4fd0-87c3-473e-a7c1-51dddaabd1b2 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:03.706406 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa4fd0-87c3-473e-a7c1-51dddaabd1b2 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:03.706848 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa4fd0-87c3-473e-a7c1-51dddaabd1b2 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:03.708225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 369/733] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:57:03.710107 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa4fd0-87c3-473e-a7c1-51dddaabd1b2 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:03.721850 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:03.723273 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:03.741783 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95eb25b-e49f-4c86-8fce-ed1cf8a1f4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:03.742594 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95eb25b-e49f-4c86-8fce-ed1cf8a1f4a8 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:03.742955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95eb25b-e49f-4c86-8fce-ed1cf8a1f4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:03.743238 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95eb25b-e49f-4c86-8fce-ed1cf8a1f4a8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:03.744979 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95eb25b-e49f-4c86-8fce-ed1cf8a1f4a8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:03.746373 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95eb25b-e49f-4c86-8fce-ed1cf8a1f4a8 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:03.758511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-e95eb25b-e49f-4c86-8fce-ed1cf8a1f4a8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:57:03.758511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:03.758511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:57:03.758511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:57:03.758511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:57:03.758511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:57:03.758511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:57:03.758511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:03.758511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:57:03.758511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:03.758511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:03.758511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:03.758511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:03.758511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:03.758511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:03.758511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:03.759709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:03.759709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:03.759709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:03.759709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:03.759709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:03.759709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:03.759709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:03.759709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:57:03.759709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:57:03.759709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:57:03.759709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:57:03.759709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:03.759709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:03.759709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:03.759709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:03.759709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:03.760751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:03.760751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:03.760751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:03.760751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:03.760751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:03.760751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:03.760751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:03.760751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:03.760751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:03.760751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:03.760751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:03.760751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:57:03.760751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:03.760751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 11:57:03.760751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:03.765149 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 365/734] 10.222.0.25 () {56 vars in 1129 bytes} [Mon Jul 11 11:57:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:57:03.766505 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feba642-a5c8-4ec7-8d69-63d4e826c3a5 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:03.766827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feba642-a5c8-4ec7-8d69-63d4e826c3a5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:03.767111 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feba642-a5c8-4ec7-8d69-63d4e826c3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:03.784411 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-5feba642-a5c8-4ec7-8d69-63d4e826c3a5 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:03.785598 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5feba642-a5c8-4ec7-8d69-63d4e826c3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:03.830683 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa4fd0-87c3-473e-a7c1-51dddaabd1b2 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:03.861584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 366/735] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:03 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:57:03.862759 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feba642-a5c8-4ec7-8d69-63d4e826c3a5 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:03.882469 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8159e-922a-40f3-b14d-745d582b0074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:03.883299 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8159e-922a-40f3-b14d-745d582b0074 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:03.883653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8159e-922a-40f3-b14d-745d582b0074 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:03.884055 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8159e-922a-40f3-b14d-745d582b0074 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:03.885642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8159e-922a-40f3-b14d-745d582b0074 None admin] RBAC: Adding query filter params (role.id=11fc9dc7c3664b2b8af8eee2462707b8, scope.project.id=6e452080fec045788d9bd5dfdb7a3c52, user.id=11550a0ca11041b0b9b175860f2b6633) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:03.886026 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8159e-922a-40f3-b14d-745d582b0074 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:03.887774 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8159e-922a-40f3-b14d-745d582b0074 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:03.894427 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 370/736] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:57:03 2022] GET /identity/v3/role_assignments?user.id=11550a0ca11041b0b9b175860f2b6633&scope.project.id=6e452080fec045788d9bd5dfdb7a3c52&role.id=11fc9dc7c3664b2b8af8eee2462707b8 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:03.895380 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8159e-922a-40f3-b14d-745d582b0074 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:03.984104 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:04.021129 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8159e-922a-40f3-b14d-745d582b0074 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:04.025367 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feba642-a5c8-4ec7-8d69-63d4e826c3a5 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:04.045246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:04.065225 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868c552-6729-4415-8cfd-f1d9a4ba785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:04.066042 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868c552-6729-4415-8cfd-f1d9a4ba785d None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:04.066395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868c552-6729-4415-8cfd-f1d9a4ba785d None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:04.066935 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868c552-6729-4415-8cfd-f1d9a4ba785d None admin] PATH_INFO: `/v3/services/network` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:04.068007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868c552-6729-4415-8cfd-f1d9a4ba785d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:04.069424 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868c552-6729-4415-8cfd-f1d9a4ba785d None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-f868c552-6729-4415-8cfd-f1d9a4ba785d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:04.083415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:04.084443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:04.084443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:04.084443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:04.084443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:04.084443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:04.084443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:04.084443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:57:04.084443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:57:04.084443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:57:04.084443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:57:04.084443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:04.084443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:04.084443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:04.084443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:04.084443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:04.084443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:04.085677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:04.085677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:04.085677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:04.085677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:04.085677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:04.085677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:04.085677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:04.085677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:04.085677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:04.085677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:04.085677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:57:04.085677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:04.085677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 11:57:04.085677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:04.085677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 371/737] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:57:03 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:57:04.089562 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d70d2d-aa00-4839-ba8e-6bb7e77e39e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:04.090417 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d70d2d-aa00-4839-ba8e-6bb7e77e39e5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:04.092684 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868c552-6729-4415-8cfd-f1d9a4ba785d None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:04.092914 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d70d2d-aa00-4839-ba8e-6bb7e77e39e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:04.093002 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d70d2d-aa00-4839-ba8e-6bb7e77e39e5 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:04.094513 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d70d2d-aa00-4839-ba8e-6bb7e77e39e5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:04.094797 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d70d2d-aa00-4839-ba8e-6bb7e77e39e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:04.096303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d70d2d-aa00-4839-ba8e-6bb7e77e39e5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:04.104435 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 367/738] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Jul 11 11:57:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:04.110531 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d70d2d-aa00-4839-ba8e-6bb7e77e39e5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:04.232842 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868c552-6729-4415-8cfd-f1d9a4ba785d None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:04.235531 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d70d2d-aa00-4839-ba8e-6bb7e77e39e5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:04.271668 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a750a-d694-4d13-8c5f-aa6692ab8d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:04.272250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a750a-d694-4d13-8c5f-aa6692ab8d38 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:04.272647 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a750a-d694-4d13-8c5f-aa6692ab8d38 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:04.272930 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a750a-d694-4d13-8c5f-aa6692ab8d38 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:04.274026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a750a-d694-4d13-8c5f-aa6692ab8d38 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:04.274026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a750a-d694-4d13-8c5f-aa6692ab8d38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:04.275524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a750a-d694-4d13-8c5f-aa6692ab8d38 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:04.281129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 368/739] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Jul 11 11:57:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:04.286535 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cca58f-f6cf-4bb5-a9b0-81626b017087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:04.287412 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cca58f-f6cf-4bb5-a9b0-81626b017087 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:04.287644 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a750a-d694-4d13-8c5f-aa6692ab8d38 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:04.288018 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cca58f-f6cf-4bb5-a9b0-81626b017087 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:04.288428 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cca58f-f6cf-4bb5-a9b0-81626b017087 None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:04.289321 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cca58f-f6cf-4bb5-a9b0-81626b017087 None admin] RBAC: Adding query filter params (name=network) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:04.289760 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cca58f-f6cf-4bb5-a9b0-81626b017087 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:04.292309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cca58f-f6cf-4bb5-a9b0-81626b017087 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:04.298688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 372/740] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Jul 11 11:57:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:04.299175 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:04.310836 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cca58f-f6cf-4bb5-a9b0-81626b017087 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:04.335581 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:04.402464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a750a-d694-4d13-8c5f-aa6692ab8d38 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:04.410892 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cca58f-f6cf-4bb5-a9b0-81626b017087 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:04.440489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d88316-9432-4355-a6da-67a3939d36d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:04.441614 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d88316-9432-4355-a6da-67a3939d36d9 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:04.442094 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d88316-9432-4355-a6da-67a3939d36d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:04.442565 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d88316-9432-4355-a6da-67a3939d36d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:04.443597 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d88316-9432-4355-a6da-67a3939d36d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:04.445158 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d88316-9432-4355-a6da-67a3939d36d9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:04.446386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27207f96-ac7e-4239-b5ca-5b9bc3342694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:04.447836 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27207f96-ac7e-4239-b5ca-5b9bc3342694 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:04.448119 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27207f96-ac7e-4239-b5ca-5b9bc3342694 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:04.448393 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27207f96-ac7e-4239-b5ca-5b9bc3342694 None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:04.449273 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27207f96-ac7e-4239-b5ca-5b9bc3342694 None admin] RBAC: Adding query filter params (type=network) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:04.449585 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27207f96-ac7e-4239-b5ca-5b9bc3342694 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:04.450974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27207f96-ac7e-4239-b5ca-5b9bc3342694 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:04.458821 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 373/741] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Jul 11 11:57:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:04.463527 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27207f96-ac7e-4239-b5ca-5b9bc3342694 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:04.476519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 369/742] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Jul 11 11:57:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:57:04.543008 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:04.592746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27207f96-ac7e-4239-b5ca-5b9bc3342694 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:04.639405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8f596-5c6f-4b63-8271-6197af38514d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:04.640083 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8f596-5c6f-4b63-8271-6197af38514d None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:04.640354 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8f596-5c6f-4b63-8271-6197af38514d None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:04.640630 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8f596-5c6f-4b63-8271-6197af38514d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:04.641363 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8f596-5c6f-4b63-8271-6197af38514d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:04.644115 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8f596-5c6f-4b63-8271-6197af38514d None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:04.666318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 374/743] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Jul 11 11:57:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:57:05.344208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9dd3c-dc28-4fd7-8bf1-e1e00d195bf9 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:05.344715 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9dd3c-dc28-4fd7-8bf1-e1e00d195bf9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:05.344791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9dd3c-dc28-4fd7-8bf1-e1e00d195bf9 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:05.346162 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 370/744] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:57:05.351280 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5469ec7-66ee-4c58-8318-4400395f1f42 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:05.351690 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5469ec7-66ee-4c58-8318-4400395f1f42 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:05.351888 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5469ec7-66ee-4c58-8318-4400395f1f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:05.369032 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-a5469ec7-66ee-4c58-8318-4400395f1f42 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:05.370350 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-a5469ec7-66ee-4c58-8318-4400395f1f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:05.442787 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 375/745] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:05 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:57:05.466730 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9dd3c-dc28-4fd7-8bf1-e1e00d195bf9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:05.561488 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:05.569917 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9dd3c-dc28-4fd7-8bf1-e1e00d195bf9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:05.604333 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9165c-9b9f-4e6a-ae98-9a842ab31fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:05.604979 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9165c-9b9f-4e6a-ae98-9a842ab31fb0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:05.605260 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9165c-9b9f-4e6a-ae98-9a842ab31fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:05.605534 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9165c-9b9f-4e6a-ae98-9a842ab31fb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:05.674277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9165c-9b9f-4e6a-ae98-9a842ab31fb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:05.675758 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9165c-9b9f-4e6a-ae98-9a842ab31fb0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:05.768400 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:05.776616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 371/746] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:57:05 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:57:05.782109 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5469ec7-66ee-4c58-8318-4400395f1f42 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:05.825065 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:05.883340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5469ec7-66ee-4c58-8318-4400395f1f42 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:05.918379 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2c87b-d4cd-45cf-9cc3-fee1ce8cbb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:05.919192 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2c87b-d4cd-45cf-9cc3-fee1ce8cbb12 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:05.919470 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2c87b-d4cd-45cf-9cc3-fee1ce8cbb12 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:05.919738 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2c87b-d4cd-45cf-9cc3-fee1ce8cbb12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:05.934479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2c87b-d4cd-45cf-9cc3-fee1ce8cbb12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:05.934479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2c87b-d4cd-45cf-9cc3-fee1ce8cbb12 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:05.952989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-00a2c87b-d4cd-45cf-9cc3-fee1ce8cbb12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:57:05.952989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:05.952989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:05.952989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:05.952989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:05.952989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:05.952989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:05.952989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:05.952989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:05.952989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:05.952989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:05.952989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:05.952989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:57:05.952989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:57:05.952989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:05.953868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:05.954761 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:57:05.954761 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:57:05.954761 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:57:05.954761 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:05.958781 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 376/747] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:57:05.960150 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9165c-9b9f-4e6a-ae98-9a842ab31fb0 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:06.060949 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9165c-9b9f-4e6a-ae98-9a842ab31fb0 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:06.095221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac7b43-d30b-4ea7-b910-8437cbee11c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:06.095878 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac7b43-d30b-4ea7-b910-8437cbee11c6 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:06.096153 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac7b43-d30b-4ea7-b910-8437cbee11c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:06.096422 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac7b43-d30b-4ea7-b910-8437cbee11c6 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:06.097130 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac7b43-d30b-4ea7-b910-8437cbee11c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:06.097431 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac7b43-d30b-4ea7-b910-8437cbee11c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:06.098836 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac7b43-d30b-4ea7-b910-8437cbee11c6 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:06.111129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 372/748] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:06.344909 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c96e3-812b-42c5-b0a7-1a8b8b369bb7 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:06.345127 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c96e3-812b-42c5-b0a7-1a8b8b369bb7 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:06.345404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c96e3-812b-42c5-b0a7-1a8b8b369bb7 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:06.346926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 377/749] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:57:06.352124 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1d828-55a9-4da9-864e-fe9f404b9eb9 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:06.352575 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1d828-55a9-4da9-864e-fe9f404b9eb9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:06.352978 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1d828-55a9-4da9-864e-fe9f404b9eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:06.373077 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-6da1d828-55a9-4da9-864e-fe9f404b9eb9 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:06.374248 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6da1d828-55a9-4da9-864e-fe9f404b9eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:06.429071 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:06.447936 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 373/750] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:06 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:57:06.470929 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c96e3-812b-42c5-b0a7-1a8b8b369bb7 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:06.563777 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:06.572373 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c96e3-812b-42c5-b0a7-1a8b8b369bb7 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:06.606931 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1090602-befd-4ec7-a61f-f91b71cf1d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:06.607681 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1090602-befd-4ec7-a61f-f91b71cf1d05 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:06.607961 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1090602-befd-4ec7-a61f-f91b71cf1d05 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:06.608231 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1090602-befd-4ec7-a61f-f91b71cf1d05 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:06.608893 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1090602-befd-4ec7-a61f-f91b71cf1d05 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:06.610288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1090602-befd-4ec7-a61f-f91b71cf1d05 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:06.624072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-c1090602-befd-4ec7-a61f-f91b71cf1d05 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:57:06.624072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:06.624072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:57:06.624072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:57:06.624072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:57:06.624072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:57:06.624072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:57:06.624072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:06.624072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:57:06.624072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:06.624072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:06.624072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:06.624072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:06.624072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:06.624072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:06.624072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:06.625317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:06.625317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:06.625317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:06.625317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:06.625317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:06.625317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:06.625317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:06.625317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:57:06.625317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:57:06.625317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:57:06.625317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:57:06.625317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:06.625317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:06.625317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:06.625317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:06.625317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:06.626161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:06.626161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:06.626161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:06.626161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:06.626161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:06.626161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:06.626161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:06.626161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:06.626161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:06.626161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:06.626161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:06.626161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:57:06.626161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:06.626161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:57:06.626161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:06.626161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 378/751] 10.222.0.25 () {56 vars in 1132 bytes} [Mon Jul 11 11:57:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:57:06.631459 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1d828-55a9-4da9-864e-fe9f404b9eb9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:06.733421 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1d828-55a9-4da9-864e-fe9f404b9eb9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:06.760606 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509619e1-c897-455b-8ced-605761e49f3a None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:06.761115 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509619e1-c897-455b-8ced-605761e49f3a None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:06.761391 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509619e1-c897-455b-8ced-605761e49f3a None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:06.762770 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 379/752] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:57:06.767634 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947001f3-70e2-4675-a0a0-f2e896f628a9 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:06.767918 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947001f3-70e2-4675-a0a0-f2e896f628a9 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:06.768192 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947001f3-70e2-4675-a0a0-f2e896f628a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:06.768564 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213a550-bec0-4553-80c6-7cecd3cb119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:06.769221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213a550-bec0-4553-80c6-7cecd3cb119a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:06.769508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213a550-bec0-4553-80c6-7cecd3cb119a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:06.769785 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213a550-bec0-4553-80c6-7cecd3cb119a None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:06.770484 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213a550-bec0-4553-80c6-7cecd3cb119a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:06.770822 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213a550-bec0-4553-80c6-7cecd3cb119a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:06.772202 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213a550-bec0-4553-80c6-7cecd3cb119a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:06.777465 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 374/753] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Jul 11 11:57:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:06.783032 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213a550-bec0-4553-80c6-7cecd3cb119a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:06.784774 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-947001f3-70e2-4675-a0a0-f2e896f628a9 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:06.785957 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-947001f3-70e2-4675-a0a0-f2e896f628a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:06.832358 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:06.853529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 380/754] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:06 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:57:06.877678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947001f3-70e2-4675-a0a0-f2e896f628a9 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:06.882826 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213a550-bec0-4553-80c6-7cecd3cb119a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:06.917285 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1ce44-6b17-4f1a-a3cf-7a5516524b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:06.917939 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1ce44-6b17-4f1a-a3cf-7a5516524b9e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:06.918222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1ce44-6b17-4f1a-a3cf-7a5516524b9e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:06.918496 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1ce44-6b17-4f1a-a3cf-7a5516524b9e None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:06.919236 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1ce44-6b17-4f1a-a3cf-7a5516524b9e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:06.919542 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1ce44-6b17-4f1a-a3cf-7a5516524b9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:06.920911 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1ce44-6b17-4f1a-a3cf-7a5516524b9e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:06.925658 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 375/755] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Jul 11 11:57:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:06.970204 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:06.984773 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947001f3-70e2-4675-a0a0-f2e896f628a9 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:07.021125 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627881f-b637-4767-bc35-e76519436458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:07.021929 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627881f-b637-4767-bc35-e76519436458 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:07.022212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627881f-b637-4767-bc35-e76519436458 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:07.022485 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627881f-b637-4767-bc35-e76519436458 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:07.023169 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627881f-b637-4767-bc35-e76519436458 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:07.024554 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627881f-b637-4767-bc35-e76519436458 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-0627881f-b637-4767-bc35-e76519436458 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:07.037144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:07.038395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:07.038395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:07.038395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:07.038395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:07.038395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:07.038395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:07.038395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:57:07.038395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:57:07.038395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:57:07.038395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:57:07.038395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:07.038395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:07.038395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:07.038395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:07.038395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:07.038395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:07.039476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:07.039476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:07.039476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:07.039476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:07.039476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:07.039476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:07.039476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:07.039476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:07.039476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:07.039476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:07.039476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:57:07.039476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:07.039476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:57:07.039476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:07.041319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 381/756] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:57:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:57:07.045028 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1ce44-6b17-4f1a-a3cf-7a5516524b9e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:07.148093 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1ce44-6b17-4f1a-a3cf-7a5516524b9e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:07.162182 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:07.192132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14006c92-b0f9-48d0-953f-949a5c1a241a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:07.192790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14006c92-b0f9-48d0-953f-949a5c1a241a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:07.193067 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14006c92-b0f9-48d0-953f-949a5c1a241a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:07.193337 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14006c92-b0f9-48d0-953f-949a5c1a241a None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:07.194033 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14006c92-b0f9-48d0-953f-949a5c1a241a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:07.194335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14006c92-b0f9-48d0-953f-949a5c1a241a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:07.195728 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14006c92-b0f9-48d0-953f-949a5c1a241a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:07.200225 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 376/757] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:57:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:07.205807 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627881f-b637-4767-bc35-e76519436458 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:07.304723 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627881f-b637-4767-bc35-e76519436458 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:07.339502 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051c233-def6-4b2a-940b-cf435df1402a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:07.340168 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051c233-def6-4b2a-940b-cf435df1402a None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:07.340450 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051c233-def6-4b2a-940b-cf435df1402a None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:07.340722 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051c233-def6-4b2a-940b-cf435df1402a None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:07.341418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051c233-def6-4b2a-940b-cf435df1402a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:07.341723 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051c233-def6-4b2a-940b-cf435df1402a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:07.343122 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051c233-def6-4b2a-940b-cf435df1402a None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:07.347528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 382/758] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:57:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:09.263614 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a150060-507a-41b6-9aba-dd94126d549c None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:09.264132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a150060-507a-41b6-9aba-dd94126d549c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:09.264214 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a150060-507a-41b6-9aba-dd94126d549c None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:09.265688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 377/759] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:57:09.270568 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3bec1-6128-408b-ab84-bb77c43de2c9 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:09.270976 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3bec1-6128-408b-ab84-bb77c43de2c9 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:09.271139 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3bec1-6128-408b-ab84-bb77c43de2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:09.287514 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-6dc3bec1-6128-408b-ab84-bb77c43de2c9 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:09.288668 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-6dc3bec1-6128-408b-ab84-bb77c43de2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:09.300521 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:09.356939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 383/760] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:09 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:57:09.380477 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a150060-507a-41b6-9aba-dd94126d549c None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:09.485647 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a150060-507a-41b6-9aba-dd94126d549c None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:09.519928 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fe3e8-9c36-452e-8220-bed47c965a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:09.520573 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fe3e8-9c36-452e-8220-bed47c965a22 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:09.520855 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fe3e8-9c36-452e-8220-bed47c965a22 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:09.521128 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fe3e8-9c36-452e-8220-bed47c965a22 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:09.521842 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fe3e8-9c36-452e-8220-bed47c965a22 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:09.523254 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77fe3e8-9c36-452e-8220-bed47c965a22 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:09.537539 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 378/761] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Jul 11 11:57:09 2022] POST /identity/v3/services => generated 269 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:57:09.596338 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e100d-39d0-4fae-b002-43c7937fb932 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:09.596625 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e100d-39d0-4fae-b002-43c7937fb932 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:09.596902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e100d-39d0-4fae-b002-43c7937fb932 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:09.598317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 384/762] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:57:09.605280 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c656b-e308-4819-9a28-1c411b392110 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:09.605566 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c656b-e308-4819-9a28-1c411b392110 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:09.605842 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c656b-e308-4819-9a28-1c411b392110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:09.623429 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-483c656b-e308-4819-9a28-1c411b392110 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:09.624674 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-483c656b-e308-4819-9a28-1c411b392110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:09.655919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:09.701692 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 379/763] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:09 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:57:09.725930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e100d-39d0-4fae-b002-43c7937fb932 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:09.829265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e100d-39d0-4fae-b002-43c7937fb932 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:09.862561 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521192f2-4258-4d3e-bf94-0ecdf5db99a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:09.863242 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521192f2-4258-4d3e-bf94-0ecdf5db99a5 None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:09.863520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521192f2-4258-4d3e-bf94-0ecdf5db99a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:09.863789 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521192f2-4258-4d3e-bf94-0ecdf5db99a5 None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:09.864496 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521192f2-4258-4d3e-bf94-0ecdf5db99a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:09.865852 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521192f2-4258-4d3e-bf94-0ecdf5db99a5 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:09.879547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 385/764] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Jul 11 11:57:09 2022] POST /identity/v3/services => generated 251 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:57:11.804638 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99b184-2e10-4153-aca5-f6b9f8412af8 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:11.805166 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99b184-2e10-4153-aca5-f6b9f8412af8 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:11.805166 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99b184-2e10-4153-aca5-f6b9f8412af8 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:11.807106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 380/765] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:57:11.812276 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62492bb3-1ae8-46fa-8afa-772d224ac657 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:11.812689 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62492bb3-1ae8-46fa-8afa-772d224ac657 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:11.812942 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62492bb3-1ae8-46fa-8afa-772d224ac657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:11.825312 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:11.831066 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-62492bb3-1ae8-46fa-8afa-772d224ac657 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:11.832664 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-62492bb3-1ae8-46fa-8afa-772d224ac657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:11.903814 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 386/766] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:11 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:57:11.927404 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99b184-2e10-4153-aca5-f6b9f8412af8 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:12.037117 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99b184-2e10-4153-aca5-f6b9f8412af8 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:12.071899 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f278e-8023-4ebe-a430-c27476e626d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:12.072621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f278e-8023-4ebe-a430-c27476e626d2 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:12.072901 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f278e-8023-4ebe-a430-c27476e626d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:12.073174 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f278e-8023-4ebe-a430-c27476e626d2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:12.073820 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f278e-8023-4ebe-a430-c27476e626d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:12.075237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f278e-8023-4ebe-a430-c27476e626d2 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:12.087277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-a78f278e-8023-4ebe-a430-c27476e626d2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:57:12.087277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:12.087277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:57:12.087277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:57:12.087277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:57:12.087277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:57:12.087277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:57:12.087277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:12.087277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:57:12.087277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:12.087277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:12.087277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:12.087277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:12.087277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:12.087277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:12.087277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:12.088232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:12.088232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:12.088232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:12.088232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:12.088232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:12.088232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:12.088232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:12.088232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:57:12.088232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:57:12.088232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:57:12.088232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:57:12.088232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:12.088232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:12.088232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:12.088232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:12.088232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:12.089076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:12.089076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:12.089076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:12.089076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:12.089076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:12.089076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:12.089076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:12.089076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:12.089076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:12.089076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:12.089076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:12.089076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:57:12.089076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:12.089076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:57:12.089076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:12.089076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 381/767] 10.222.0.25 () {56 vars in 1132 bytes} [Mon Jul 11 11:57:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:57:12.094348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62492bb3-1ae8-46fa-8afa-772d224ac657 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:12.114817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e466e-84d6-4580-959e-58cfe44ca512 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:12.115108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e466e-84d6-4580-959e-58cfe44ca512 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:12.115390 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e466e-84d6-4580-959e-58cfe44ca512 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:12.116745 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 382/768] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:57:12.123319 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162e1b7-8337-4a61-bb2a-ee48bfa51e41 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:12.123613 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162e1b7-8337-4a61-bb2a-ee48bfa51e41 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:12.123892 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162e1b7-8337-4a61-bb2a-ee48bfa51e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:12.141060 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-0162e1b7-8337-4a61-bb2a-ee48bfa51e41 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:12.142249 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0162e1b7-8337-4a61-bb2a-ee48bfa51e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:12.168735 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:12.195757 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62492bb3-1ae8-46fa-8afa-772d224ac657 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:12.215886 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 383/769] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:12 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:57:12.225355 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:12.232067 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5efef-8b15-4248-956d-34fd420567c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:12.232734 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5efef-8b15-4248-956d-34fd420567c9 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:12.233020 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5efef-8b15-4248-956d-34fd420567c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:12.233295 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5efef-8b15-4248-956d-34fd420567c9 None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:12.234003 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5efef-8b15-4248-956d-34fd420567c9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:12.234310 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5efef-8b15-4248-956d-34fd420567c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:12.235710 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5efef-8b15-4248-956d-34fd420567c9 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:12.240490 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 387/770] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Jul 11 11:57:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:12.240730 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162e1b7-8337-4a61-bb2a-ee48bfa51e41 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:12.246595 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5efef-8b15-4248-956d-34fd420567c9 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:12.338647 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162e1b7-8337-4a61-bb2a-ee48bfa51e41 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:12.344398 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5efef-8b15-4248-956d-34fd420567c9 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:12.374764 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21b29d-094b-4130-b30e-d3c5551f364d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:12.375554 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21b29d-094b-4130-b30e-d3c5551f364d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:12.375836 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21b29d-094b-4130-b30e-d3c5551f364d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:12.376104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21b29d-094b-4130-b30e-d3c5551f364d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:12.376740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21b29d-094b-4130-b30e-d3c5551f364d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:12.378111 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21b29d-094b-4130-b30e-d3c5551f364d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:12.379006 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b05a2a-8f2e-4f97-8283-2b2431f354ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:12.379656 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b05a2a-8f2e-4f97-8283-2b2431f354ca None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:12.379945 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b05a2a-8f2e-4f97-8283-2b2431f354ca None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:12.380228 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b05a2a-8f2e-4f97-8283-2b2431f354ca None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:12.380924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b05a2a-8f2e-4f97-8283-2b2431f354ca None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:12.381307 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b05a2a-8f2e-4f97-8283-2b2431f354ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:12.382576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b05a2a-8f2e-4f97-8283-2b2431f354ca None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:12.387772 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 388/771] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Jul 11 11:57:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-5e21b29d-094b-4130-b30e-d3c5551f364d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:12.389717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:12.390868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:12.390868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:12.390868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:12.390868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:12.390868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:12.390868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:12.390868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:57:12.390868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:57:12.390868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:57:12.390868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:57:12.390868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:12.390868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:12.390868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:12.390868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:12.390868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:12.390868 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:12.392108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:12.392108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:12.392108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:12.392108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:12.392108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:12.392108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:12.392108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:12.392108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:12.392108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:12.392108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:12.392108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:57:12.392108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:12.392108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:57:12.392108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:12.392108 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 384/772] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:57:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:57:12.395773 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b05a2a-8f2e-4f97-8283-2b2431f354ca None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:12.396370 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21b29d-094b-4130-b30e-d3c5551f364d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:12.422836 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:12.454438 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:12.495978 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b05a2a-8f2e-4f97-8283-2b2431f354ca None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:12.497450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21b29d-094b-4130-b30e-d3c5551f364d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:12.528743 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4bc9c-2764-4089-ab01-7cacf9b9b2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:12.529391 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4bc9c-2764-4089-ab01-7cacf9b9b2f4 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:12.529679 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4bc9c-2764-4089-ab01-7cacf9b9b2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:12.529954 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4bc9c-2764-4089-ab01-7cacf9b9b2f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:12.530290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb59de-94e5-43f5-a021-2d75ee4b5a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:12.530743 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4bc9c-2764-4089-ab01-7cacf9b9b2f4 None admin] RBAC: Adding query filter params (interface=public, service_id=66c07c921ec5468b8444c48a055f9dc6, region_id=RegionOne) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:12.530965 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb59de-94e5-43f5-a021-2d75ee4b5a2a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:12.531063 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4bc9c-2764-4089-ab01-7cacf9b9b2f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:12.531240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb59de-94e5-43f5-a021-2d75ee4b5a2a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:12.531515 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb59de-94e5-43f5-a021-2d75ee4b5a2a None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:12.532199 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb59de-94e5-43f5-a021-2d75ee4b5a2a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:12.532414 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4bc9c-2764-4089-ab01-7cacf9b9b2f4 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:12.532508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb59de-94e5-43f5-a021-2d75ee4b5a2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:12.533869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb59de-94e5-43f5-a021-2d75ee4b5a2a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:12.537654 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 389/773] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Jul 11 11:57:12 2022] GET /identity/v3/endpoints?service_id=66c07c921ec5468b8444c48a055f9dc6&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:12.538505 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 385/774] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:57:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:12.543871 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4bc9c-2764-4089-ab01-7cacf9b9b2f4 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:12.544614 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb59de-94e5-43f5-a021-2d75ee4b5a2a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:12.627983 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:12.645080 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4bc9c-2764-4089-ab01-7cacf9b9b2f4 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:12.645266 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb59de-94e5-43f5-a021-2d75ee4b5a2a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:12.668466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:12.678944 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef7f02-1bd2-4aaf-a3e4-c952ad246b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:12.679332 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87b8d3-9ec1-4bee-9ca4-7dda1298bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:12.679599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef7f02-1bd2-4aaf-a3e4-c952ad246b83 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:12.679882 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef7f02-1bd2-4aaf-a3e4-c952ad246b83 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:12.679993 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87b8d3-9ec1-4bee-9ca4-7dda1298bd36 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:12.680157 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef7f02-1bd2-4aaf-a3e4-c952ad246b83 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:12.680278 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87b8d3-9ec1-4bee-9ca4-7dda1298bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:12.680551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87b8d3-9ec1-4bee-9ca4-7dda1298bd36 None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:12.681362 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef7f02-1bd2-4aaf-a3e4-c952ad246b83 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:12.681917 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef7f02-1bd2-4aaf-a3e4-c952ad246b83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:12.682104 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87b8d3-9ec1-4bee-9ca4-7dda1298bd36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:12.683058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef7f02-1bd2-4aaf-a3e4-c952ad246b83 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:12.683488 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87b8d3-9ec1-4bee-9ca4-7dda1298bd36 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:12.687905 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 386/775] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:57:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:12.702738 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 390/776] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Jul 11 11:57:12 2022] GET /identity/v3/services => generated 1498 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:57:12.702961 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef7f02-1bd2-4aaf-a3e4-c952ad246b83 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:12.805568 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef7f02-1bd2-4aaf-a3e4-c952ad246b83 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:12.844183 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939af107-636d-4bf7-99e3-6452ff8f5682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:12.844856 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939af107-636d-4bf7-99e3-6452ff8f5682 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:12.845142 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939af107-636d-4bf7-99e3-6452ff8f5682 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:12.845420 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939af107-636d-4bf7-99e3-6452ff8f5682 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:12.846212 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939af107-636d-4bf7-99e3-6452ff8f5682 None admin] RBAC: Adding query filter params (interface=public, service_id=52e2f0ddd7d841d5a6b946d69746f3e5, region_id=RegionOne) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:12.846524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939af107-636d-4bf7-99e3-6452ff8f5682 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:12.847998 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939af107-636d-4bf7-99e3-6452ff8f5682 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:12.855039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 387/777] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Jul 11 11:57:12 2022] GET /identity/v3/endpoints?service_id=52e2f0ddd7d841d5a6b946d69746f3e5&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:12.860798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87b8d3-9ec1-4bee-9ca4-7dda1298bd36 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:12.965006 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87b8d3-9ec1-4bee-9ca4-7dda1298bd36 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:13.003180 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8017d-41db-4694-803f-19049f3ec2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:13.003839 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8017d-41db-4694-803f-19049f3ec2e1 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:13.004120 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8017d-41db-4694-803f-19049f3ec2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:13.004394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8017d-41db-4694-803f-19049f3ec2e1 None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:13.005063 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8017d-41db-4694-803f-19049f3ec2e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:13.006429 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8017d-41db-4694-803f-19049f3ec2e1 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:13.012765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 391/778] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Jul 11 11:57:12 2022] GET /identity/v3/services => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:57:14.929406 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d52fe3-164d-4e7e-8f2a-60e7e964eb58 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:14.929979 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d52fe3-164d-4e7e-8f2a-60e7e964eb58 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:14.929979 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d52fe3-164d-4e7e-8f2a-60e7e964eb58 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:14.932211 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 388/779] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:57:14.937372 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aa053-1f2d-4e14-9ad2-933e3204fb4e None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:14.937787 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aa053-1f2d-4e14-9ad2-933e3204fb4e None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:14.937934 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aa053-1f2d-4e14-9ad2-933e3204fb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:14.955010 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-f30aa053-1f2d-4e14-9ad2-933e3204fb4e None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:14.956197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-f30aa053-1f2d-4e14-9ad2-933e3204fb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:15.005748 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:15.025910 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 392/780] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:14 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:57:15.051217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d52fe3-164d-4e7e-8f2a-60e7e964eb58 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:15.068666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:15.159599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d52fe3-164d-4e7e-8f2a-60e7e964eb58 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:15.195271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035e4c4-82cb-4f69-905f-36091d6aa485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:15.196018 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035e4c4-82cb-4f69-905f-36091d6aa485 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:15.196307 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035e4c4-82cb-4f69-905f-36091d6aa485 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:15.196583 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035e4c4-82cb-4f69-905f-36091d6aa485 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:15.197236 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035e4c4-82cb-4f69-905f-36091d6aa485 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:15.198601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035e4c4-82cb-4f69-905f-36091d6aa485 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:15.210950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-3035e4c4-82cb-4f69-905f-36091d6aa485 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:57:15.210950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:15.210950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:57:15.210950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:57:15.210950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:57:15.210950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:57:15.210950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:57:15.210950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:15.210950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:57:15.210950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:15.210950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:15.210950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:15.210950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:15.210950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:15.210950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:15.210950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:15.212091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:15.212091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:15.212091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:15.212091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:15.212091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:15.212091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:15.212091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:15.212091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:57:15.212091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:57:15.212091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:57:15.212091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:57:15.212091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:15.212091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:15.212091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:15.212091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:15.212091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:15.213208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:15.213208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:15.213208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:15.213208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:15.213208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:15.213208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:15.213208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:15.213208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:15.213208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:15.213208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:15.213208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:15.213208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:57:15.213208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:15.213208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 11:57:15.213208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:15.214388 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 389/781] 10.222.0.25 () {56 vars in 1132 bytes} [Mon Jul 11 11:57:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:57:15.217944 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aa053-1f2d-4e14-9ad2-933e3204fb4e None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:15.241332 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361a9f6-ad9a-40e2-909d-227b16757cc0 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:15.241622 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361a9f6-ad9a-40e2-909d-227b16757cc0 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:15.241905 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361a9f6-ad9a-40e2-909d-227b16757cc0 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:15.244017 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 390/782] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:57:15.248752 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5724d9-0ee2-4192-a012-4461ff6af63e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:15.249037 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5724d9-0ee2-4192-a012-4461ff6af63e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:15.249308 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5724d9-0ee2-4192-a012-4461ff6af63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:15.265412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-5f5724d9-0ee2-4192-a012-4461ff6af63e None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:15.266580 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5f5724d9-0ee2-4192-a012-4461ff6af63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:15.317473 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aa053-1f2d-4e14-9ad2-933e3204fb4e None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:15.333667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 391/783] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:15 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:57:15.350297 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42781-be58-4693-9cc7-4deaa958769c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:15.350981 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42781-be58-4693-9cc7-4deaa958769c None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:15.351263 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42781-be58-4693-9cc7-4deaa958769c None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:15.351537 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42781-be58-4693-9cc7-4deaa958769c None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:15.352233 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea42781-be58-4693-9cc7-4deaa958769c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:15.352855 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea42781-be58-4693-9cc7-4deaa958769c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:15.354852 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea42781-be58-4693-9cc7-4deaa958769c None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:15.358880 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5724d9-0ee2-4192-a012-4461ff6af63e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:15.359699 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 393/784] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Jul 11 11:57:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:15.365232 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42781-be58-4693-9cc7-4deaa958769c None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:15.368925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:15.410671 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:15.457213 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5724d9-0ee2-4192-a012-4461ff6af63e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:15.464196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42781-be58-4693-9cc7-4deaa958769c None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:15.491613 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24e13c-90ff-49f9-ae31-0c9999245df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:15.492409 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24e13c-90ff-49f9-ae31-0c9999245df0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:15.492693 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24e13c-90ff-49f9-ae31-0c9999245df0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:15.492974 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24e13c-90ff-49f9-ae31-0c9999245df0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:15.494192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24e13c-90ff-49f9-ae31-0c9999245df0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:15.495615 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24e13c-90ff-49f9-ae31-0c9999245df0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:15.498493 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b5cf6-648c-45c7-b5d1-70143205482c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:15.499180 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b5cf6-648c-45c7-b5d1-70143205482c None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:15.499465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b5cf6-648c-45c7-b5d1-70143205482c None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:15.499740 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b5cf6-648c-45c7-b5d1-70143205482c None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:15.500438 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b5cf6-648c-45c7-b5d1-70143205482c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:15.500742 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b5cf6-648c-45c7-b5d1-70143205482c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:15.502086 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b5cf6-648c-45c7-b5d1-70143205482c None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:15.506792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 394/785] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Jul 11 11:57:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-5b24e13c-90ff-49f9-ae31-0c9999245df0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:15.507297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:15.508541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:15.508541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:15.508541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:15.508541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:15.508541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:15.508541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:15.508541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:57:15.508541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:57:15.508541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:57:15.508541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:57:15.508541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:15.508541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:15.508541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:15.508541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:15.508541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:15.508541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:15.509765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:15.509765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:15.509765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:15.509765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:15.509765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:15.509765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:15.509765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:15.509765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:15.509765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:15.509765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:15.509765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:57:15.509765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:15.509765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 11:57:15.509765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:15.509765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 392/786] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:57:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:57:15.512970 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b5cf6-648c-45c7-b5d1-70143205482c None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:15.514151 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24e13c-90ff-49f9-ae31-0c9999245df0 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:15.584189 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:15.612569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b5cf6-648c-45c7-b5d1-70143205482c None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:15.615616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24e13c-90ff-49f9-ae31-0c9999245df0 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:15.623239 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:15.646675 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8a670-1724-416d-a31f-82b8df4c59b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:15.647371 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8a670-1724-416d-a31f-82b8df4c59b4 None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:15.647660 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8a670-1724-416d-a31f-82b8df4c59b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:15.647937 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8a670-1724-416d-a31f-82b8df4c59b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:15.648663 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8a670-1724-416d-a31f-82b8df4c59b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:15.650551 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed343fdb-8336-414a-ab28-9b063a01b097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:15.650691 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8a670-1724-416d-a31f-82b8df4c59b4 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:15.651227 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed343fdb-8336-414a-ab28-9b063a01b097 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:15.651513 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed343fdb-8336-414a-ab28-9b063a01b097 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:15.651783 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed343fdb-8336-414a-ab28-9b063a01b097 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:15.652469 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed343fdb-8336-414a-ab28-9b063a01b097 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:15.652770 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed343fdb-8336-414a-ab28-9b063a01b097 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:15.654116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed343fdb-8336-414a-ab28-9b063a01b097 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:15.658856 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 393/787] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:57:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:15.664947 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed343fdb-8336-414a-ab28-9b063a01b097 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:15.669418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 395/788] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Jul 11 11:57:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:57:15.772527 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed343fdb-8336-414a-ab28-9b063a01b097 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:15.809621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:15.815091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211938f-de44-447f-88d8-a83f1aad41ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:15.815757 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211938f-de44-447f-88d8-a83f1aad41ed None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:15.816042 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211938f-de44-447f-88d8-a83f1aad41ed None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:15.816313 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211938f-de44-447f-88d8-a83f1aad41ed None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:15.817070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211938f-de44-447f-88d8-a83f1aad41ed None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:15.817376 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211938f-de44-447f-88d8-a83f1aad41ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:15.818802 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211938f-de44-447f-88d8-a83f1aad41ed None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:15.824916 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 394/789] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Jul 11 11:57:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:15.830833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8a670-1724-416d-a31f-82b8df4c59b4 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:15.933789 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8a670-1724-416d-a31f-82b8df4c59b4 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:15.966821 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1efaff-6afc-4fb6-947b-9d6036d5bf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:15.967496 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1efaff-6afc-4fb6-947b-9d6036d5bf87 None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:15.967777 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1efaff-6afc-4fb6-947b-9d6036d5bf87 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:15.968060 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1efaff-6afc-4fb6-947b-9d6036d5bf87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:15.968793 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1efaff-6afc-4fb6-947b-9d6036d5bf87 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:15.970169 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1efaff-6afc-4fb6-947b-9d6036d5bf87 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:15.989822 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 396/790] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Jul 11 11:57:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:57:17.990152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b3e80-f345-449e-a714-6153e27f7f54 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:17.990686 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b3e80-f345-449e-a714-6153e27f7f54 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:17.990686 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b3e80-f345-449e-a714-6153e27f7f54 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:17.992095 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 395/791] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:57:17.997596 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b0889-cb20-4e54-8aed-7d845f72b746 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:17.998028 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b0889-cb20-4e54-8aed-7d845f72b746 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:17.998198 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b0889-cb20-4e54-8aed-7d845f72b746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:18.016889 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-c80b0889-cb20-4e54-8aed-7d845f72b746 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:18.018135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-c80b0889-cb20-4e54-8aed-7d845f72b746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:18.036339 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:18.097800 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 397/792] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:17 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:57:18.121782 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b3e80-f345-449e-a714-6153e27f7f54 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:18.215137 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5672e44-fffa-4e57-af84-60482aa3c5d7 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:18.215421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5672e44-fffa-4e57-af84-60482aa3c5d7 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:18.215698 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5672e44-fffa-4e57-af84-60482aa3c5d7 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:18.217476 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 398/793] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:57:18.222274 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb8e07-f602-4ef6-b830-9d559c75b49a None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:18.222560 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb8e07-f602-4ef6-b830-9d559c75b49a None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:18.222880 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb8e07-f602-4ef6-b830-9d559c75b49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:18.229906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b3e80-f345-449e-a714-6153e27f7f54 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:18.239508 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-1afb8e07-f602-4ef6-b830-9d559c75b49a None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:18.240742 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-1afb8e07-f602-4ef6-b830-9d559c75b49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:18.264544 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b00d5-e692-4fa7-a133-709c3fae9c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:18.265325 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b00d5-e692-4fa7-a133-709c3fae9c44 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:18.265609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b00d5-e692-4fa7-a133-709c3fae9c44 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:18.265880 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b00d5-e692-4fa7-a133-709c3fae9c44 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:18.266517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b00d5-e692-4fa7-a133-709c3fae9c44 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:18.267915 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b00d5-e692-4fa7-a133-709c3fae9c44 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-489b00d5-e692-4fa7-a133-709c3fae9c44 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:18.280135 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:18.281288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:18.281288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:18.281288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:18.281288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:18.281288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:18.281288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:18.281288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:57:18.281288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:57:18.281288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:57:18.281288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:57:18.281288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:18.281288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:18.281288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:18.281288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:18.281288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:18.281288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:18.282125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:18.282125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:18.282125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:18.282125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:18.282125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:18.282125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:18.282125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:18.282125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:18.282125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:18.282125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:18.282125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:57:18.282125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:18.282125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:57:18.282125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:18.282125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 396/794] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:57:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:57:18.287114 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b00d5-e692-4fa7-a133-709c3fae9c44 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:18.308174 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 399/795] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:18 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:57:18.332835 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb8e07-f602-4ef6-b830-9d559c75b49a None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:18.348487 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:18.392747 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b00d5-e692-4fa7-a133-709c3fae9c44 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:18.412931 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:18.429799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a8f5b-7e44-4237-b236-53f77e853713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:18.430455 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a8f5b-7e44-4237-b236-53f77e853713 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:18.431370 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a8f5b-7e44-4237-b236-53f77e853713 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:18.431654 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a8f5b-7e44-4237-b236-53f77e853713 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:18.432342 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a8f5b-7e44-4237-b236-53f77e853713 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:18.432647 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a8f5b-7e44-4237-b236-53f77e853713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:18.434014 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a8f5b-7e44-4237-b236-53f77e853713 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:18.435182 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb8e07-f602-4ef6-b830-9d559c75b49a None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:18.438574 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 397/796] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Jul 11 11:57:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:18.444229 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a8f5b-7e44-4237-b236-53f77e853713 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:18.468947 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56ffd8-e0db-4bf4-9b84-50798afede78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:18.469608 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56ffd8-e0db-4bf4-9b84-50798afede78 None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:18.469892 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56ffd8-e0db-4bf4-9b84-50798afede78 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:18.470172 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56ffd8-e0db-4bf4-9b84-50798afede78 None admin] PATH_INFO: `/v3/projects` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:18.470909 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56ffd8-e0db-4bf4-9b84-50798afede78 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:18.472333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56ffd8-e0db-4bf4-9b84-50798afede78 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:18.473689 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: WARNING keystone.server.flask.common [None req-fc56ffd8-e0db-4bf4-9b84-50798afede78 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 11:57:18.490857 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.sql.core [None req-fc56ffd8-e0db-4bf4-9b84-50798afede78 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 11:57:18.490857 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 11:57:18.490857 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [parameters: {'id': 'efdb642684a54fe0bf1a1c258ec3b109', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 11:57:18.490857 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87217) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 11:57:18.517148 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-fc56ffd8-e0db-4bf4-9b84-50798afede78 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id efdb642684a54fe0bf1a1c258ec3b109.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id efdb642684a54fe0bf1a1c258ec3b109. Jul 11 11:57:18.517148 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:18.517148 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 11:57:18.517148 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 11:57:18.517148 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 11:57:18.517148 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 11:57:18.517148 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 11:57:18.517148 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 11:57:18.517148 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 11:57:18.517148 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application conn.query(q) Jul 11 11:57:18.517148 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 11:57:18.517148 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 11:57:18.517148 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application result.read() Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 11 11:57:18.517968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application next(self.gen) Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application yield resource Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application next(self.gen) Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise self.value Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application session.commit() Jul 11 11:57:18.519040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self.session.flush() Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application compat.raise_( Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 11:57:18.519968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 11:57:18.521669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 11:57:18.521669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 11:57:18.521669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 11:57:18.521669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 11:57:18.521669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 11:57:18.521669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 11:57:18.521669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 11:57:18.521669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 11:57:18.521669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 11:57:18.521669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 11:57:18.521669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 11:57:18.521669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 11:57:18.521669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 11:57:18.521669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 11:57:18.521669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application conn.query(q) Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application result.read() Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 11:57:18.522479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 11:57:18.523389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 11:57:18.523389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 11:57:18.523389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 11:57:18.523389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 11:57:18.523389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 11:57:18.523389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 11:57:18.523389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 11:57:18.523389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 11:57:18.523389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [parameters: {'id': 'efdb642684a54fe0bf1a1c258ec3b109', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 11:57:18.523389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 11:57:18.523389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:18.523389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:18.523389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:18.523389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:18.523389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:18.524576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:18.525618 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:18.525618 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 11 11:57:18.525618 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 11 11:57:18.525618 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:18.525618 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:18.525618 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 11 11:57:18.525618 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 11 11:57:18.525618 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id efdb642684a54fe0bf1a1c258ec3b109. Jul 11 11:57:18.525618 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:18.525618 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 400/797] 10.222.0.25 () {60 vars in 1140 bytes} [Mon Jul 11 11:57:18 2022] POST /identity/v3/projects => generated 262 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:57:18.525618 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56ffd8-e0db-4bf4-9b84-50798afede78 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:18.556175 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a8f5b-7e44-4237-b236-53f77e853713 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:18.579434 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:18.591066 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be308a81-02bd-4b72-96f5-dbc10ebbafea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:18.591799 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be308a81-02bd-4b72-96f5-dbc10ebbafea None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:18.592162 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be308a81-02bd-4b72-96f5-dbc10ebbafea None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:18.592439 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be308a81-02bd-4b72-96f5-dbc10ebbafea None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:18.593136 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be308a81-02bd-4b72-96f5-dbc10ebbafea None admin] RBAC: Adding query filter params (type=compute) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:18.593441 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be308a81-02bd-4b72-96f5-dbc10ebbafea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:18.594835 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be308a81-02bd-4b72-96f5-dbc10ebbafea None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:18.599269 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 398/798] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Jul 11 11:57:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:57:18.633360 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56ffd8-e0db-4bf4-9b84-50798afede78 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:18.671558 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19fae9-8950-4931-a894-93154ec828c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:18.672366 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19fae9-8950-4931-a894-93154ec828c5 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:18.672648 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19fae9-8950-4931-a894-93154ec828c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:18.672921 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19fae9-8950-4931-a894-93154ec828c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:18.675309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:18.682054 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19fae9-8950-4931-a894-93154ec828c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:18.684529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19fae9-8950-4931-a894-93154ec828c5 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:18.700531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-3e19fae9-8950-4931-a894-93154ec828c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:57:18.700531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:18.700531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:18.700531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:18.700531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:18.700531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:18.700531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:18.700531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:18.700531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:18.700531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:18.700531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:18.700531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:18.700531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:57:18.700531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:57:18.700531 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:18.701526 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:18.702649 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:57:18.702649 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:57:18.702649 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:57:18.702649 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:57:18.702649 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:57:18.702649 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:57:18.702649 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:57:18.702649 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:18.702649 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 401/799] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:57:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:57:18.707875 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be308a81-02bd-4b72-96f5-dbc10ebbafea None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:18.815460 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be308a81-02bd-4b72-96f5-dbc10ebbafea None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:18.850087 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c15469-8bd3-4349-9e6e-de750f47c932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:18.850755 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c15469-8bd3-4349-9e6e-de750f47c932 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:18.851043 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c15469-8bd3-4349-9e6e-de750f47c932 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:18.851319 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c15469-8bd3-4349-9e6e-de750f47c932 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:18.852054 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c15469-8bd3-4349-9e6e-de750f47c932 None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:18.852365 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c15469-8bd3-4349-9e6e-de750f47c932 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:18.854255 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c15469-8bd3-4349-9e6e-de750f47c932 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:18.871296 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 399/800] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Jul 11 11:57:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:20.835267 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90698248-93ab-4b9d-8cf4-3eb754257ea3 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:20.835793 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90698248-93ab-4b9d-8cf4-3eb754257ea3 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:20.835878 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90698248-93ab-4b9d-8cf4-3eb754257ea3 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:20.840035 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 402/801] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:57:20.845172 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22231d87-7efd-4e57-8a04-2156e057c84a None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:20.845573 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22231d87-7efd-4e57-8a04-2156e057c84a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:20.845735 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22231d87-7efd-4e57-8a04-2156e057c84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:20.863747 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-22231d87-7efd-4e57-8a04-2156e057c84a None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:20.864934 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-22231d87-7efd-4e57-8a04-2156e057c84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:20.908417 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:20.932148 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 400/802] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:20 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:57:20.956339 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90698248-93ab-4b9d-8cf4-3eb754257ea3 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:21.065886 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90698248-93ab-4b9d-8cf4-3eb754257ea3 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:21.099172 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4ca92-0578-4d40-85e3-1cf5d9507bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:21.099760 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ca92-0578-4d40-85e3-1cf5d9507bf0 None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:21.100045 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ca92-0578-4d40-85e3-1cf5d9507bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:21.100322 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ca92-0578-4d40-85e3-1cf5d9507bf0 None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:21.101057 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4ca92-0578-4d40-85e3-1cf5d9507bf0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:21.103141 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4ca92-0578-4d40-85e3-1cf5d9507bf0 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:21.117334 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 403/803] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Jul 11 11:57:20 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:57:21.147765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dc510-76f3-42d4-a731-cc7ecdfbd770 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:21.148174 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dc510-76f3-42d4-a731-cc7ecdfbd770 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:21.148532 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dc510-76f3-42d4-a731-cc7ecdfbd770 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:21.150623 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 401/804] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:57:21.156734 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21a069-fc6f-4127-8730-f6ef436573fe None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:21.157050 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21a069-fc6f-4127-8730-f6ef436573fe None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:21.157347 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21a069-fc6f-4127-8730-f6ef436573fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:21.177590 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-2d21a069-fc6f-4127-8730-f6ef436573fe None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:21.179198 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-2d21a069-fc6f-4127-8730-f6ef436573fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:21.232918 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:21.259230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 404/805] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:21 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:57:21.286227 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dc510-76f3-42d4-a731-cc7ecdfbd770 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:21.392025 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dc510-76f3-42d4-a731-cc7ecdfbd770 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:21.425830 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d1d1e-8fa9-4c6e-ac5f-8c6dc1959ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:21.426495 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d1d1e-8fa9-4c6e-ac5f-8c6dc1959ff9 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:21.426804 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d1d1e-8fa9-4c6e-ac5f-8c6dc1959ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:21.427080 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d1d1e-8fa9-4c6e-ac5f-8c6dc1959ff9 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:21.427767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d1d1e-8fa9-4c6e-ac5f-8c6dc1959ff9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:21.429202 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d1d1e-8fa9-4c6e-ac5f-8c6dc1959ff9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:21.430534 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: WARNING keystone.server.flask.common [None req-e86d1d1e-8fa9-4c6e-ac5f-8c6dc1959ff9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 11:57:21.442310 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.sql.core [None req-e86d1d1e-8fa9-4c6e-ac5f-8c6dc1959ff9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 11:57:21.442310 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 11:57:21.442310 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [parameters: {'user_id': 'd8edffb31b4a47ab915e24fcbf87a700', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 11:57:21.442310 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87216) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 11:57:21.458279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-e86d1d1e-8fa9-4c6e-ac5f-8c6dc1959ff9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 11:57:21.458279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:21.458279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 11:57:21.458279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 11:57:21.458279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 11:57:21.458279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 11:57:21.458279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 11:57:21.458279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 11:57:21.458279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 11:57:21.458279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application conn.query(q) Jul 11 11:57:21.458279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 11:57:21.458279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 11:57:21.458279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 11:57:21.458279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application result.read() Jul 11 11:57:21.458279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 11:57:21.459222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application next(self.gen) Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application yield resource Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application next(self.gen) Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise self.value Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application session.commit() Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 11:57:21.460197 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self.session.flush() Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application compat.raise_( Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 11:57:21.461271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 11:57:21.463272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 11:57:21.463272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 11:57:21.463272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 11 11:57:21.463272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 11 11:57:21.463272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 11:57:21.463272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 11:57:21.463272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 11:57:21.463272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 11:57:21.463272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 11:57:21.463272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 11:57:21.463272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 11:57:21.463272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 11:57:21.463272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 11:57:21.463272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 11:57:21.463272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 11:57:21.463272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception Jul 11 11:57:21.464113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 11:57:21.464113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 11:57:21.464113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 11:57:21.464113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 11:57:21.464113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 11:57:21.464113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 11:57:21.464113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 11:57:21.464113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application conn.query(q) Jul 11 11:57:21.464113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 11:57:21.464113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 11:57:21.464113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 11:57:21.464113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application result.read() Jul 11 11:57:21.464113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 11:57:21.464113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 11:57:21.464113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 11:57:21.464113 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 11:57:21.464952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 11:57:21.464952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 11:57:21.464952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 11:57:21.464952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 11:57:21.464952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 11:57:21.464952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 11:57:21.464952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd8edffb31b4a47ab915e24fcbf87a700', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 11:57:21.464952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 11:57:21.464952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:21.464952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:21.464952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:21.464952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:21.464952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:21.464952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:21.464952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 11 11:57:21.465767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 11 11:57:21.466740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 11 11:57:21.466740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 11 11:57:21.466740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 11:57:21.466740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 11:57:21.466740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 11:57:21.466740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:21.466740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 402/806] 10.222.0.25 () {60 vars in 1131 bytes} [Mon Jul 11 11:57:21 2022] POST /identity/v3/users => generated 160 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:57:21.467159 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21a069-fc6f-4127-8730-f6ef436573fe None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:21.561663 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21a069-fc6f-4127-8730-f6ef436573fe None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:21.594197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b96b5-dba6-49a5-9b15-9966f6975dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:21.595015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b96b5-dba6-49a5-9b15-9966f6975dde None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:21.595295 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b96b5-dba6-49a5-9b15-9966f6975dde None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:21.595563 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b96b5-dba6-49a5-9b15-9966f6975dde None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:21.603203 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b96b5-dba6-49a5-9b15-9966f6975dde None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:21.604619 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b96b5-dba6-49a5-9b15-9966f6975dde None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:21.619088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-b81b96b5-dba6-49a5-9b15-9966f6975dde None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 11:57:21.619088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:21.619088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:21.619088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:21.619088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:21.619088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:21.619088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:21.619088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:21.619088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:21.619088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:21.619088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:21.619088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:21.619088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:57:21.619088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:57:21.619088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:57:21.619088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:21.621135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:21.623296 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:21.623296 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:21.623296 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:57:21.623296 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:57:21.623296 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:57:21.623296 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:57:21.623296 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:57:21.623296 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:57:21.623296 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 11:57:21.623296 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:21.623296 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 405/807] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:57:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:57:21.626221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d1d1e-8fa9-4c6e-ac5f-8c6dc1959ff9 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:21.670175 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:21.729243 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d1d1e-8fa9-4c6e-ac5f-8c6dc1959ff9 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:21.762112 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8287c-d5b0-419f-ad87-b3fa5951c7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:21.762795 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8287c-d5b0-419f-ad87-b3fa5951c7f9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:21.763081 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8287c-d5b0-419f-ad87-b3fa5951c7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:21.763355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8287c-d5b0-419f-ad87-b3fa5951c7f9 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:21.764144 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8287c-d5b0-419f-ad87-b3fa5951c7f9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:21.764448 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8287c-d5b0-419f-ad87-b3fa5951c7f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:21.766080 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8287c-d5b0-419f-ad87-b3fa5951c7f9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:21.803037 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 403/808] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Jul 11 11:57:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:23.363042 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c57e4-027f-443b-abba-511d1009bb28 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:23.363562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c57e4-027f-443b-abba-511d1009bb28 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:23.363649 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c57e4-027f-443b-abba-511d1009bb28 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:23.364957 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 406/809] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:57:23.370241 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea03c9-c092-4cb6-8549-5c5551acb67c None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:23.370632 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea03c9-c092-4cb6-8549-5c5551acb67c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:23.370822 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea03c9-c092-4cb6-8549-5c5551acb67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:23.388280 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-27ea03c9-c092-4cb6-8549-5c5551acb67c None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:23.389772 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-27ea03c9-c092-4cb6-8549-5c5551acb67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:23.458655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 404/810] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:23 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:57:23.483174 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c57e4-027f-443b-abba-511d1009bb28 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:23.525422 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:23.582354 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c57e4-027f-443b-abba-511d1009bb28 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:23.614804 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881e40d-3b2d-4afc-af21-723c9965c5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:23.615576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881e40d-3b2d-4afc-af21-723c9965c5fe None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:23.615859 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881e40d-3b2d-4afc-af21-723c9965c5fe None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:23.616135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881e40d-3b2d-4afc-af21-723c9965c5fe None admin] PATH_INFO: `/v3/services/compute` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:23.616775 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881e40d-3b2d-4afc-af21-723c9965c5fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:23.619015 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881e40d-3b2d-4afc-af21-723c9965c5fe None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-3881e40d-3b2d-4afc-af21-723c9965c5fe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:23.630356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:23.631483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:23.631483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:23.631483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:23.631483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:23.631483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:23.631483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:23.631483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:57:23.631483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:57:23.631483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:57:23.631483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:57:23.631483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:23.631483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:23.631483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:23.631483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:23.631483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:23.631483 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:23.632381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:23.632381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:23.632381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:23.632381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:23.632381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:23.632381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:23.632381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:23.632381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:23.632381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:23.632381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:23.632381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:57:23.632381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:23.632381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:57:23.632381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:57:23.632381 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 407/811] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:57:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:57:23.638219 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea03c9-c092-4cb6-8549-5c5551acb67c None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:23.665495 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:23.737452 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea03c9-c092-4cb6-8549-5c5551acb67c None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:23.772669 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c94bc-bfbe-4edf-897b-fe7cfb901800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:23.773317 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c94bc-bfbe-4edf-897b-fe7cfb901800 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:23.773596 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c94bc-bfbe-4edf-897b-fe7cfb901800 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:23.773864 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c94bc-bfbe-4edf-897b-fe7cfb901800 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:23.774584 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c94bc-bfbe-4edf-897b-fe7cfb901800 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:23.774913 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c94bc-bfbe-4edf-897b-fe7cfb901800 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:23.776278 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c94bc-bfbe-4edf-897b-fe7cfb901800 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:23.780980 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 405/812] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Jul 11 11:57:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:23.786766 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881e40d-3b2d-4afc-af21-723c9965c5fe None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:23.884719 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881e40d-3b2d-4afc-af21-723c9965c5fe None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:23.887041 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:23.918326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f22bdb-e748-45a8-9e3d-f13a2c48b99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:23.919014 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f22bdb-e748-45a8-9e3d-f13a2c48b99f None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:23.919296 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f22bdb-e748-45a8-9e3d-f13a2c48b99f None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:23.919565 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f22bdb-e748-45a8-9e3d-f13a2c48b99f None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:23.920256 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f22bdb-e748-45a8-9e3d-f13a2c48b99f None admin] RBAC: Adding query filter params (type=compute) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:23.920556 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f22bdb-e748-45a8-9e3d-f13a2c48b99f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:23.921906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f22bdb-e748-45a8-9e3d-f13a2c48b99f None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:23.926633 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 408/813] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Jul 11 11:57:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:23.933079 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c94bc-bfbe-4edf-897b-fe7cfb901800 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:24.022392 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:24.031449 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c94bc-bfbe-4edf-897b-fe7cfb901800 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:24.069476 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6df6b3-a500-40d9-8a21-2767dfe5d314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:24.070127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6df6b3-a500-40d9-8a21-2767dfe5d314 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:24.070411 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6df6b3-a500-40d9-8a21-2767dfe5d314 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:24.070685 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6df6b3-a500-40d9-8a21-2767dfe5d314 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:24.071513 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6df6b3-a500-40d9-8a21-2767dfe5d314 None admin] RBAC: Adding query filter params (interface=public, service_id=fe71f008bd4a4cb4b477ff1fe69142e7, region_id=RegionOne) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:24.071821 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6df6b3-a500-40d9-8a21-2767dfe5d314 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:24.073187 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6df6b3-a500-40d9-8a21-2767dfe5d314 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:24.078214 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 406/814] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Jul 11 11:57:23 2022] GET /identity/v3/endpoints?service_id=fe71f008bd4a4cb4b477ff1fe69142e7&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:24.083899 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f22bdb-e748-45a8-9e3d-f13a2c48b99f None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:24.184637 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f22bdb-e748-45a8-9e3d-f13a2c48b99f None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:24.220219 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fd2c7-e2ac-438c-bb73-be1b22517cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:24.220878 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fd2c7-e2ac-438c-bb73-be1b22517cd1 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:24.221164 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fd2c7-e2ac-438c-bb73-be1b22517cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:24.221442 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fd2c7-e2ac-438c-bb73-be1b22517cd1 None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:24.222118 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fd2c7-e2ac-438c-bb73-be1b22517cd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:24.223514 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fd2c7-e2ac-438c-bb73-be1b22517cd1 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:24.230468 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 409/815] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Jul 11 11:57:24 2022] GET /identity/v3/services => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:57:26.447118 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6f935-35c3-45c8-8084-dd54a8a3b300 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:26.447613 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6f935-35c3-45c8-8084-dd54a8a3b300 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:26.447613 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6f935-35c3-45c8-8084-dd54a8a3b300 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:26.449121 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 407/816] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:57:26.454327 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bf079-362d-4893-823b-5abe555fe277 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:26.454781 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bf079-362d-4893-823b-5abe555fe277 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:26.454902 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bf079-362d-4893-823b-5abe555fe277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:26.472359 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-9d5bf079-362d-4893-823b-5abe555fe277 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:57:26.473532 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-9d5bf079-362d-4893-823b-5abe555fe277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:57:26.498250 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:26.539011 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 410/817] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:57:26 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:57:26.563948 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6f935-35c3-45c8-8084-dd54a8a3b300 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:26.663318 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6f935-35c3-45c8-8084-dd54a8a3b300 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:26.695894 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc527fe4-4ce4-4f77-a074-81c5404b81c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:26.696668 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc527fe4-4ce4-4f77-a074-81c5404b81c3 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:26.696948 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc527fe4-4ce4-4f77-a074-81c5404b81c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:26.697269 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc527fe4-4ce4-4f77-a074-81c5404b81c3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:26.697856 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc527fe4-4ce4-4f77-a074-81c5404b81c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:26.699258 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc527fe4-4ce4-4f77-a074-81c5404b81c3 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-dc527fe4-4ce4-4f77-a074-81c5404b81c3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:57:26.710761 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:57:26.712640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:57:26.712640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:57:26.712640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:57:26.712640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:57:26.712640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:57:26.712640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:57:26.712640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:57:26.712640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:57:26.712640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:57:26.712640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:57:26.712640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:57:26.712640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:57:26.712640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:57:26.712640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:57:26.712640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:57:26.712640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:57:26.713616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:57:26.713616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:57:26.713616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:57:26.713616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:57:26.713616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:57:26.713616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:57:26.713616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:57:26.713616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:57:26.713616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:57:26.713616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:57:26.713616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:57:26.713616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:57:26.713616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 11:57:26.713616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:57:26.713616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 408/818] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:57:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:57:26.718177 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bf079-362d-4893-823b-5abe555fe277 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:26.813189 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bf079-362d-4893-823b-5abe555fe277 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:26.846511 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50411538-57ce-4db9-acc2-91e019ef266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:26.847184 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50411538-57ce-4db9-acc2-91e019ef266a None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:26.847465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50411538-57ce-4db9-acc2-91e019ef266a None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:26.847735 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50411538-57ce-4db9-acc2-91e019ef266a None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:26.848422 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50411538-57ce-4db9-acc2-91e019ef266a None admin] RBAC: Adding query filter params (name=compute) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:26.848722 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50411538-57ce-4db9-acc2-91e019ef266a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:26.850064 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50411538-57ce-4db9-acc2-91e019ef266a None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:26.855618 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 411/819] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Jul 11 11:57:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:26.861298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc527fe4-4ce4-4f77-a074-81c5404b81c3 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:26.882856 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:26.958418 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc527fe4-4ce4-4f77-a074-81c5404b81c3 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:26.995133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16d8e7-a37a-44ae-8d67-e81db34801bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:26.995777 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16d8e7-a37a-44ae-8d67-e81db34801bb None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:26.996057 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16d8e7-a37a-44ae-8d67-e81db34801bb None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:26.996327 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16d8e7-a37a-44ae-8d67-e81db34801bb None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:26.997017 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16d8e7-a37a-44ae-8d67-e81db34801bb None admin] RBAC: Adding query filter params (type=compute) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:57:26.997320 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16d8e7-a37a-44ae-8d67-e81db34801bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:26.998688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16d8e7-a37a-44ae-8d67-e81db34801bb None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:27.003445 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 409/820] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Jul 11 11:57:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:57:27.009675 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50411538-57ce-4db9-acc2-91e019ef266a None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:57:27.036161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:27.106406 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50411538-57ce-4db9-acc2-91e019ef266a None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:57:27.143009 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc989ff-c766-4458-9989-c1148a254c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:57:27.143677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc989ff-c766-4458-9989-c1148a254c31 None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:57:27.143961 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc989ff-c766-4458-9989-c1148a254c31 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:57:27.144234 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc989ff-c766-4458-9989-c1148a254c31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:57:27.144974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc989ff-c766-4458-9989-c1148a254c31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:57:27.146336 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc989ff-c766-4458-9989-c1148a254c31 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:57:27.163806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 412/821] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Jul 11 11:57:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:57:37.001393 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=58 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:57:37.159680 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=58,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:28.276169 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8290e0-0439-4a1c-9072-5a2cbd950cc3 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:28.276850 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8290e0-0439-4a1c-9072-5a2cbd950cc3 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:28.276850 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8290e0-0439-4a1c-9072-5a2cbd950cc3 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:28.278104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 410/822] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:58:28.283439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e54ce-f7d0-4c3a-897e-338a6cde83ef None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:28.283881 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e54ce-f7d0-4c3a-897e-338a6cde83ef None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:28.284007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e54ce-f7d0-4c3a-897e-338a6cde83ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:28.302107 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-d52e54ce-f7d0-4c3a-897e-338a6cde83ef None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:58:28.303433 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-d52e54ce-f7d0-4c3a-897e-338a6cde83ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:58:28.389369 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 413/823] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:58:28 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:58:28.417654 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8290e0-0439-4a1c-9072-5a2cbd950cc3 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:28.547530 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8290e0-0439-4a1c-9072-5a2cbd950cc3 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:28.591064 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fff02-8a6e-438e-b5ed-f7cd83e64fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:28.591867 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fff02-8a6e-438e-b5ed-f7cd83e64fb7 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:28.592157 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fff02-8a6e-438e-b5ed-f7cd83e64fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:28.592435 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fff02-8a6e-438e-b5ed-f7cd83e64fb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:28.609228 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fff02-8a6e-438e-b5ed-f7cd83e64fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:28.610981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fff02-8a6e-438e-b5ed-f7cd83e64fb7 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:28.631762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-c30fff02-8a6e-438e-b5ed-f7cd83e64fb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:28.631762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:28.631762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:28.631762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:28.631762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:28.631762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:28.631762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:28.631762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:28.631762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:28.631762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:28.631762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:28.631762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:28.631762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:58:28.631762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:58:28.631762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:28.632851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:28.633802 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:58:28.633802 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:58:28.633802 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:28.633802 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:58:28.633802 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 411/824] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:28.640022 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e54ce-f7d0-4c3a-897e-338a6cde83ef None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:28.777576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e54ce-f7d0-4c3a-897e-338a6cde83ef None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:28.821691 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:28.829383 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1ad47-780f-48ad-ad8c-edf8cd6238d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:28.830214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1ad47-780f-48ad-ad8c-edf8cd6238d7 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:28.830549 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1ad47-780f-48ad-ad8c-edf8cd6238d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:28.830987 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1ad47-780f-48ad-ad8c-edf8cd6238d7 None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:28.831855 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1ad47-780f-48ad-ad8c-edf8cd6238d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:28.832311 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1ad47-780f-48ad-ad8c-edf8cd6238d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:28.833986 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1ad47-780f-48ad-ad8c-edf8cd6238d7 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:28.849231 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 414/825] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:28.857224 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fff02-8a6e-438e-b5ed-f7cd83e64fb7 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:28.927595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:28.989464 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fff02-8a6e-438e-b5ed-f7cd83e64fb7 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:29.030889 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbf471-a32c-4d24-a50e-5da11c4a0db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:29.031666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbf471-a32c-4d24-a50e-5da11c4a0db5 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:29.031952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbf471-a32c-4d24-a50e-5da11c4a0db5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:29.032267 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbf471-a32c-4d24-a50e-5da11c4a0db5 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:29.033041 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbf471-a32c-4d24-a50e-5da11c4a0db5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:29.034556 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbf471-a32c-4d24-a50e-5da11c4a0db5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:29.057309 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 412/826] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Jul 11 11:58:28 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 11:58:31.457829 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1234fc-a193-460c-9da9-940c15645de4 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:31.458402 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1234fc-a193-460c-9da9-940c15645de4 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:31.458402 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1234fc-a193-460c-9da9-940c15645de4 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:31.460938 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 415/827] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:58:31.466527 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bf937-936c-416e-8243-3eead47aa9bf None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:31.466966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bf937-936c-416e-8243-3eead47aa9bf None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:31.467121 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bf937-936c-416e-8243-3eead47aa9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:31.484918 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-259bf937-936c-416e-8243-3eead47aa9bf None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:58:31.486255 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-259bf937-936c-416e-8243-3eead47aa9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:58:31.565929 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 413/828] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:58:31 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:58:31.593218 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1234fc-a193-460c-9da9-940c15645de4 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:31.702923 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1234fc-a193-460c-9da9-940c15645de4 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:31.742903 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f5879-4878-4128-9ca4-0d4d803638ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:31.743689 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f5879-4878-4128-9ca4-0d4d803638ad None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:31.743974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f5879-4878-4128-9ca4-0d4d803638ad None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:31.744368 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f5879-4878-4128-9ca4-0d4d803638ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:31.755932 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f5879-4878-4128-9ca4-0d4d803638ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:58:31.765284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-064f5879-4878-4128-9ca4-0d4d803638ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:58:31.765284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:31.765284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:31.765284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:31.765284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:31.765284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:31.765284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:31.765284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:31.765284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:31.765284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:31.765284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:31.765284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:31.765284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:58:31.765284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:58:31.765284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:58:31.765284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:58:31.766326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:58:31.766326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:58:31.766326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:58:31.766326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:58:31.766326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:31.766326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:31.766326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:31.766326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:31.766326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:31.766326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:31.766326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:31.766326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:31.766326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:31.766326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:31.766326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:31.766326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:31.767352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:31.767352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:31.767352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:31.767352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:31.767352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:58:31.767352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:58:31.767352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:58:31.767352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:58:31.767352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:58:31.767352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:58:31.767352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:58:31.767352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:31.767352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 416/829] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:58:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:31.774216 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bf937-936c-416e-8243-3eead47aa9bf None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:31.820744 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:31.892053 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bf937-936c-416e-8243-3eead47aa9bf None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:31.927638 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5340021-be3f-4615-8e32-5f789d84f00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:31.928347 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5340021-be3f-4615-8e32-5f789d84f00c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:31.929243 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5340021-be3f-4615-8e32-5f789d84f00c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:31.929496 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5340021-be3f-4615-8e32-5f789d84f00c None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:31.930239 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5340021-be3f-4615-8e32-5f789d84f00c None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:31.930566 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5340021-be3f-4615-8e32-5f789d84f00c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:31.932002 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5340021-be3f-4615-8e32-5f789d84f00c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:31.940483 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 414/830] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Jul 11 11:58:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:31.947798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f5879-4878-4128-9ca4-0d4d803638ad None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:31.999959 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:32.058418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f5879-4878-4128-9ca4-0d4d803638ad None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:32.094342 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f5a96-e03b-4d2f-a7fd-e65dfdec6d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:32.095230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f5a96-e03b-4d2f-a7fd-e65dfdec6d64 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:32.095525 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f5a96-e03b-4d2f-a7fd-e65dfdec6d64 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:32.095788 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f5a96-e03b-4d2f-a7fd-e65dfdec6d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:32.111301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f5a96-e03b-4d2f-a7fd-e65dfdec6d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:32.112771 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f5a96-e03b-4d2f-a7fd-e65dfdec6d64 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:32.134248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-218f5a96-e03b-4d2f-a7fd-e65dfdec6d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:32.134248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:32.134248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:32.134248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:32.134248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:32.134248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:32.134248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:32.134248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:32.134248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:32.134248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:32.134248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:32.134248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:32.134248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:58:32.134248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:58:32.134248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:32.135465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:32.136760 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:58:32.136760 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:58:32.136760 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:32.136760 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:32.142380 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 417/831] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:32.143187 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5340021-be3f-4615-8e32-5f789d84f00c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:32.259331 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:32.262310 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5340021-be3f-4615-8e32-5f789d84f00c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:32.304540 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f707c-5f7f-4445-aca1-a6a10b1b31d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:32.305206 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f707c-5f7f-4445-aca1-a6a10b1b31d8 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:32.305487 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f707c-5f7f-4445-aca1-a6a10b1b31d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:32.305760 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f707c-5f7f-4445-aca1-a6a10b1b31d8 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:32.306473 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f707c-5f7f-4445-aca1-a6a10b1b31d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:32.306873 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f707c-5f7f-4445-aca1-a6a10b1b31d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:32.308314 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f707c-5f7f-4445-aca1-a6a10b1b31d8 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:32.321717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 415/832] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:58:32.328417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f5a96-e03b-4d2f-a7fd-e65dfdec6d64 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:32.454576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:32.459223 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f5a96-e03b-4d2f-a7fd-e65dfdec6d64 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:32.507878 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062c44c-9573-4fea-83af-53a00317f688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:32.508809 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c44c-9573-4fea-83af-53a00317f688 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:32.509161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c44c-9573-4fea-83af-53a00317f688 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:32.510682 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c44c-9573-4fea-83af-53a00317f688 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:32.517906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062c44c-9573-4fea-83af-53a00317f688 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:32.519562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062c44c-9573-4fea-83af-53a00317f688 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:32.537229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-7062c44c-9573-4fea-83af-53a00317f688 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:58:32.537229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:32.537229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:32.537229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:32.537229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:32.537229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:32.537229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:32.537229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:32.537229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:32.537229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:32.537229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:32.537229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:32.537229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:58:32.537229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:58:32.537229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:58:32.537229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:32.540135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:32.542259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:32.542259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:32.542259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:58:32.542259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:58:32.542259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:58:32.542259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:58:32.542259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:58:32.542259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:58:32.542259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:58:32.542259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:32.542259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 418/833] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:32.546339 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f707c-5f7f-4445-aca1-a6a10b1b31d8 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:32.672408 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f707c-5f7f-4445-aca1-a6a10b1b31d8 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:32.716385 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0907d-625e-43c9-81e0-8c01c9b57dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:32.717053 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0907d-625e-43c9-81e0-8c01c9b57dc0 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:32.717337 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0907d-625e-43c9-81e0-8c01c9b57dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:32.717611 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0907d-625e-43c9-81e0-8c01c9b57dc0 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:32.718435 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0907d-625e-43c9-81e0-8c01c9b57dc0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:32.718771 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0907d-625e-43c9-81e0-8c01c9b57dc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:32.720207 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0907d-625e-43c9-81e0-8c01c9b57dc0 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:32.738543 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 416/834] 10.222.0.25 () {56 vars in 1143 bytes} [Mon Jul 11 11:58:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:32.744451 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062c44c-9573-4fea-83af-53a00317f688 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:32.850216 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062c44c-9573-4fea-83af-53a00317f688 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:32.889736 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc659c5-d64c-46b8-a0d5-1352d5280603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:32.890489 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc659c5-d64c-46b8-a0d5-1352d5280603 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:32.890768 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc659c5-d64c-46b8-a0d5-1352d5280603 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:32.891074 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc659c5-d64c-46b8-a0d5-1352d5280603 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:32.921504 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:32.980502 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc659c5-d64c-46b8-a0d5-1352d5280603 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:32.981961 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc659c5-d64c-46b8-a0d5-1352d5280603 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:33.087458 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 419/835] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:58:32 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:58:33.093301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0907d-625e-43c9-81e0-8c01c9b57dc0 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:33.114560 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:33.205755 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0907d-625e-43c9-81e0-8c01c9b57dc0 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:33.243336 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93098414-2c35-4525-9ec8-89317cbcabda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:33.244206 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93098414-2c35-4525-9ec8-89317cbcabda None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:33.244553 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93098414-2c35-4525-9ec8-89317cbcabda None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:33.244835 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93098414-2c35-4525-9ec8-89317cbcabda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:33.256210 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93098414-2c35-4525-9ec8-89317cbcabda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:33.257957 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93098414-2c35-4525-9ec8-89317cbcabda None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:33.277589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-93098414-2c35-4525-9ec8-89317cbcabda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:33.277589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:33.277589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:33.277589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:33.277589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:33.277589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:33.277589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:33.277589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:33.277589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:33.277589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:33.277589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:33.277589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:33.277589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:58:33.277589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:58:33.277589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:33.278595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:33.279551 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:58:33.279551 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:58:33.279551 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:33.279551 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:58:33.279551 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 417/836] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:33.284579 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc659c5-d64c-46b8-a0d5-1352d5280603 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:33.347478 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:33.392460 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc659c5-d64c-46b8-a0d5-1352d5280603 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:33.430811 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076d47d-a019-4c52-a1ec-29ccef0fbdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:33.431484 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076d47d-a019-4c52-a1ec-29ccef0fbdc2 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:33.431770 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076d47d-a019-4c52-a1ec-29ccef0fbdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:33.432048 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076d47d-a019-4c52-a1ec-29ccef0fbdc2 None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:33.432772 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076d47d-a019-4c52-a1ec-29ccef0fbdc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:33.433075 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076d47d-a019-4c52-a1ec-29ccef0fbdc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:33.434596 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076d47d-a019-4c52-a1ec-29ccef0fbdc2 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:33.446502 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 420/837] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:58:33.452474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93098414-2c35-4525-9ec8-89317cbcabda None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:33.529164 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:33.563078 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93098414-2c35-4525-9ec8-89317cbcabda None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:33.599008 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8301326-0cab-4905-83e8-7c142efce28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:33.599806 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301326-0cab-4905-83e8-7c142efce28c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:33.600094 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301326-0cab-4905-83e8-7c142efce28c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:33.600404 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301326-0cab-4905-83e8-7c142efce28c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:33.608333 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8301326-0cab-4905-83e8-7c142efce28c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:33.610051 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8301326-0cab-4905-83e8-7c142efce28c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:33.624981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-d8301326-0cab-4905-83e8-7c142efce28c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:58:33.624981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:33.624981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:33.624981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:33.624981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:33.624981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:33.624981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:33.624981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:33.624981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:33.624981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:33.624981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:33.624981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:33.624981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:58:33.624981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:58:33.624981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:33.626283 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:33.627232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:58:33.627232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:58:33.627232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:58:33.627232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:58:33.627232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:58:33.627232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:58:33.627232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:58:33.627232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:58:33.627232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 418/838] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:58:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:58:33.633186 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076d47d-a019-4c52-a1ec-29ccef0fbdc2 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:33.742873 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076d47d-a019-4c52-a1ec-29ccef0fbdc2 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:33.762001 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:33.781763 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a1610-b8a7-4473-9357-9bf6d3d56f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:33.782433 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a1610-b8a7-4473-9357-9bf6d3d56f7a None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:33.782761 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a1610-b8a7-4473-9357-9bf6d3d56f7a None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:33.783058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a1610-b8a7-4473-9357-9bf6d3d56f7a None admin] PATH_INFO: `/v3/projects` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:33.783874 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a1610-b8a7-4473-9357-9bf6d3d56f7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:33.784182 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a1610-b8a7-4473-9357-9bf6d3d56f7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:33.785706 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a1610-b8a7-4473-9357-9bf6d3d56f7a None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:33.798090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 421/839] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:58:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:33.804976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8301326-0cab-4905-83e8-7c142efce28c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:33.924534 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8301326-0cab-4905-83e8-7c142efce28c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:33.956514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:33.965007 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f42fc5-40c8-4063-9d25-54b14ffd2e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:33.965741 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f42fc5-40c8-4063-9d25-54b14ffd2e92 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:33.966089 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f42fc5-40c8-4063-9d25-54b14ffd2e92 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:33.966341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f42fc5-40c8-4063-9d25-54b14ffd2e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:33.967302 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f42fc5-40c8-4063-9d25-54b14ffd2e92 None admin] RBAC: Adding query filter params (role.id=22d318004ece47b3a0d4d3919bfebdc9, scope.project.id=6e452080fec045788d9bd5dfdb7a3c52, user.id=fc6d2bcfca0a495582d322494b054045) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:33.967620 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f42fc5-40c8-4063-9d25-54b14ffd2e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:33.969187 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f42fc5-40c8-4063-9d25-54b14ffd2e92 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:33.975559 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 419/840] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:58:33 2022] GET /identity/v3/role_assignments?user.id=fc6d2bcfca0a495582d322494b054045&scope.project.id=6e452080fec045788d9bd5dfdb7a3c52&role.id=22d318004ece47b3a0d4d3919bfebdc9 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:36.360365 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ecd51-eb45-4259-aa11-e0273855b780 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:36.360941 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ecd51-eb45-4259-aa11-e0273855b780 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:36.360941 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ecd51-eb45-4259-aa11-e0273855b780 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:36.362781 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 422/841] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:58:36.368612 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48552526-81f0-4d0e-b3b5-5fdb10996892 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:36.369003 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48552526-81f0-4d0e-b3b5-5fdb10996892 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:36.369162 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48552526-81f0-4d0e-b3b5-5fdb10996892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:36.387199 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-48552526-81f0-4d0e-b3b5-5fdb10996892 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:58:36.388507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-48552526-81f0-4d0e-b3b5-5fdb10996892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:58:36.464714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 420/842] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:58:36 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:58:36.490308 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ecd51-eb45-4259-aa11-e0273855b780 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:36.603306 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ecd51-eb45-4259-aa11-e0273855b780 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:36.648954 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57e26f-2818-4b78-bd0c-efa3975687e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:36.648954 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57e26f-2818-4b78-bd0c-efa3975687e2 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:36.648954 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57e26f-2818-4b78-bd0c-efa3975687e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:36.648954 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57e26f-2818-4b78-bd0c-efa3975687e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:36.658919 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57e26f-2818-4b78-bd0c-efa3975687e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:58:36.668176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-8a57e26f-2818-4b78-bd0c-efa3975687e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:58:36.668176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:36.668176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:36.668176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:36.668176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:36.668176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:36.668176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:36.668176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:36.668176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:36.668176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:36.668176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:36.668176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:36.668176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:58:36.668176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:58:36.668176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:58:36.668176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:58:36.669370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:58:36.669370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:58:36.669370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:58:36.669370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:58:36.669370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:36.669370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:36.669370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:36.669370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:36.669370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:36.669370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:36.669370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:36.669370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:36.669370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:36.669370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:36.669370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:36.669370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:36.670387 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:36.670387 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:36.670387 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:36.670387 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:36.670387 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:58:36.670387 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:58:36.670387 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:58:36.670387 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:58:36.670387 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:58:36.670387 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:58:36.670387 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:58:36.670387 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:36.670387 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 423/843] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:58:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:36.675964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48552526-81f0-4d0e-b3b5-5fdb10996892 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:36.786593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48552526-81f0-4d0e-b3b5-5fdb10996892 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:36.815599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:36.829444 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19d885-4319-44b3-9077-b485abdcdf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:36.830217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19d885-4319-44b3-9077-b485abdcdf8f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:36.830599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19d885-4319-44b3-9077-b485abdcdf8f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:36.830915 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19d885-4319-44b3-9077-b485abdcdf8f None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:36.831745 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19d885-4319-44b3-9077-b485abdcdf8f None admin] RBAC: Adding query filter params (name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:36.832074 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19d885-4319-44b3-9077-b485abdcdf8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:36.833659 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19d885-4319-44b3-9077-b485abdcdf8f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:36.843314 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 421/844] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Jul 11 11:58:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:36.849159 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57e26f-2818-4b78-bd0c-efa3975687e2 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:36.895214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:36.963017 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57e26f-2818-4b78-bd0c-efa3975687e2 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:37.002291 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfd2bd-ab42-46ac-a008-f57a2ad57e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:37.003297 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfd2bd-ab42-46ac-a008-f57a2ad57e90 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:37.003748 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfd2bd-ab42-46ac-a008-f57a2ad57e90 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:37.004227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfd2bd-ab42-46ac-a008-f57a2ad57e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:37.021635 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfd2bd-ab42-46ac-a008-f57a2ad57e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:37.024139 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfd2bd-ab42-46ac-a008-f57a2ad57e90 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:37.046491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-f7dfd2bd-ab42-46ac-a008-f57a2ad57e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:37.046491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:37.046491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:37.046491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:37.046491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:37.046491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:37.046491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:37.046491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:37.046491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:37.046491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:37.046491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:37.046491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:37.046491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:58:37.046491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:58:37.046491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:37.047994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:37.049102 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:58:37.049102 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:58:37.049102 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:37.049102 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:37.049102 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 424/845] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:37.053765 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19d885-4319-44b3-9077-b485abdcdf8f None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:37.169110 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19d885-4319-44b3-9077-b485abdcdf8f None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:37.205830 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a26d9-5d26-4680-b230-437e7ea620ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:37.206490 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a26d9-5d26-4680-b230-437e7ea620ae None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:37.206807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a26d9-5d26-4680-b230-437e7ea620ae None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:37.207077 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a26d9-5d26-4680-b230-437e7ea620ae None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:37.207969 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a26d9-5d26-4680-b230-437e7ea620ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:37.208289 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a26d9-5d26-4680-b230-437e7ea620ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:37.210493 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a26d9-5d26-4680-b230-437e7ea620ae None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:37.224423 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 422/846] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:58:37.231500 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfd2bd-ab42-46ac-a008-f57a2ad57e90 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:37.324752 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:37.335984 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfd2bd-ab42-46ac-a008-f57a2ad57e90 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:37.370802 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbc90f-fdc5-4770-87b8-049c8ea9edda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:37.371640 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbc90f-fdc5-4770-87b8-049c8ea9edda None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:37.371925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbc90f-fdc5-4770-87b8-049c8ea9edda None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:37.372201 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbc90f-fdc5-4770-87b8-049c8ea9edda None admin] PATH_INFO: `/v3/users/placement` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:37.379449 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbc90f-fdc5-4770-87b8-049c8ea9edda None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:37.381105 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbc90f-fdc5-4770-87b8-049c8ea9edda None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:37.399062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-58fbc90f-fdc5-4770-87b8-049c8ea9edda None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:58:37.399062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:37.399062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:37.399062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:37.399062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:37.399062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:37.399062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:37.399062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:37.399062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:37.399062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:37.399062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:37.399062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:37.399062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:58:37.399062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:58:37.399062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:58:37.399062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:37.400037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:37.400991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:37.400991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:37.400991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:58:37.400991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:58:37.400991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:58:37.400991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:58:37.400991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:58:37.400991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:58:37.400991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:58:37.400991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:37.400991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 425/847] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:37.406259 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a26d9-5d26-4680-b230-437e7ea620ae None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:37.459031 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:37.530480 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a26d9-5d26-4680-b230-437e7ea620ae None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:37.568176 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a7578-62d9-45bf-ba6a-8ff6727d5b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:37.568936 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a7578-62d9-45bf-ba6a-8ff6727d5b36 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:37.569262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a7578-62d9-45bf-ba6a-8ff6727d5b36 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:37.569537 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a7578-62d9-45bf-ba6a-8ff6727d5b36 None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:37.570439 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a7578-62d9-45bf-ba6a-8ff6727d5b36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:37.570789 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a7578-62d9-45bf-ba6a-8ff6727d5b36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:37.572230 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a7578-62d9-45bf-ba6a-8ff6727d5b36 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:37.592986 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 423/848] 10.222.0.25 () {56 vars in 1143 bytes} [Mon Jul 11 11:58:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:37.598593 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbc90f-fdc5-4770-87b8-049c8ea9edda None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:37.714419 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbc90f-fdc5-4770-87b8-049c8ea9edda None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:37.752941 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd52b9a-7d90-4208-9f7b-2927b75f8bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:37.753734 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd52b9a-7d90-4208-9f7b-2927b75f8bf8 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:37.754022 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd52b9a-7d90-4208-9f7b-2927b75f8bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:37.754297 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd52b9a-7d90-4208-9f7b-2927b75f8bf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:37.765278 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd52b9a-7d90-4208-9f7b-2927b75f8bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:37.766940 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd52b9a-7d90-4208-9f7b-2927b75f8bf8 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:37.790598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-0fd52b9a-7d90-4208-9f7b-2927b75f8bf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:37.790598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:37.790598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:37.790598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:37.790598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:37.790598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:37.790598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:37.790598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:37.790598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:37.790598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:37.790598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:37.790598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:37.790598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:58:37.790598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:58:37.790598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:37.791784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:37.792869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:58:37.792869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:58:37.792869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:37.792869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:37.792869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 426/849] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:37.797443 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a7578-62d9-45bf-ba6a-8ff6727d5b36 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:37.910297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a7578-62d9-45bf-ba6a-8ff6727d5b36 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:37.912757 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:37.945884 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26183f17-c5d1-48f8-8629-b64cec05358c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:37.946550 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26183f17-c5d1-48f8-8629-b64cec05358c None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:37.946872 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26183f17-c5d1-48f8-8629-b64cec05358c None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:37.947148 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26183f17-c5d1-48f8-8629-b64cec05358c None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:37.947859 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26183f17-c5d1-48f8-8629-b64cec05358c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:37.948164 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26183f17-c5d1-48f8-8629-b64cec05358c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:37.949559 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26183f17-c5d1-48f8-8629-b64cec05358c None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:37.962173 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 424/850] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:37.968102 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd52b9a-7d90-4208-9f7b-2927b75f8bf8 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:37.972009 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:38.090288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd52b9a-7d90-4208-9f7b-2927b75f8bf8 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:38.130353 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849266fb-da52-43f7-a16c-794d86f89758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:38.131251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849266fb-da52-43f7-a16c-794d86f89758 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:38.132280 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849266fb-da52-43f7-a16c-794d86f89758 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:38.134477 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849266fb-da52-43f7-a16c-794d86f89758 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:38.140200 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849266fb-da52-43f7-a16c-794d86f89758 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:38.141802 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849266fb-da52-43f7-a16c-794d86f89758 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:38.156853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-849266fb-da52-43f7-a16c-794d86f89758 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:58:38.156853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:38.156853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:38.156853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:38.156853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:38.156853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:38.156853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:38.156853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:38.156853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:38.156853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:38.156853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:38.156853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:38.156853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:58:38.156853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:58:38.156853 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:38.157943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:38.164573 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:58:38.164573 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:58:38.164573 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:58:38.164573 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:58:38.164573 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:58:38.164573 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:58:38.164573 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:58:38.164573 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:38.164573 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 427/851] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:58:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:38.165091 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26183f17-c5d1-48f8-8629-b64cec05358c None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:38.287606 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26183f17-c5d1-48f8-8629-b64cec05358c None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:38.326515 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d0404-520e-452e-b641-2e67cec10181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:38.327224 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d0404-520e-452e-b641-2e67cec10181 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:38.327508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d0404-520e-452e-b641-2e67cec10181 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:38.327783 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d0404-520e-452e-b641-2e67cec10181 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:38.328559 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d0404-520e-452e-b641-2e67cec10181 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:38.328871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d0404-520e-452e-b641-2e67cec10181 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:38.330314 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d0404-520e-452e-b641-2e67cec10181 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:38.344786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 425/852] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:58:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:38.352654 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849266fb-da52-43f7-a16c-794d86f89758 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:38.422799 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:38.468111 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849266fb-da52-43f7-a16c-794d86f89758 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:38.502997 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a7d8e-ad10-4baa-8ad5-db4f53e41503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:38.503903 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a7d8e-ad10-4baa-8ad5-db4f53e41503 None admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:38.504228 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a7d8e-ad10-4baa-8ad5-db4f53e41503 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:38.504444 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a7d8e-ad10-4baa-8ad5-db4f53e41503 None admin] PATH_INFO: `/v3/projects/6e452080fec045788d9bd5dfdb7a3c52/users/fc6d2bcfca0a495582d322494b054045/roles/22d318004ece47b3a0d4d3919bfebdc9` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:38.521204 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a7d8e-ad10-4baa-8ad5-db4f53e41503 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e452080fec045788d9bd5dfdb7a3c52, user_id=fc6d2bcfca0a495582d322494b054045, role_id=22d318004ece47b3a0d4d3919bfebdc9)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:38.523597 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a7d8e-ad10-4baa-8ad5-db4f53e41503 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:38.536883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 428/853] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Jul 11 11:58:38 2022] PUT /identity/v3/projects/6e452080fec045788d9bd5dfdb7a3c52/users/fc6d2bcfca0a495582d322494b054045/roles/22d318004ece47b3a0d4d3919bfebdc9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:58:41.079649 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58824205-57b7-41c6-a591-26514a38901b None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:41.080207 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58824205-57b7-41c6-a591-26514a38901b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:41.080207 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58824205-57b7-41c6-a591-26514a38901b None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:41.081729 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 426/854] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:58:41.089513 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6198e7-af66-42d0-a192-ca7ea083341b None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:41.089972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6198e7-af66-42d0-a192-ca7ea083341b None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:41.090111 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6198e7-af66-42d0-a192-ca7ea083341b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:41.113319 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-de6198e7-af66-42d0-a192-ca7ea083341b None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:58:41.114794 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-de6198e7-af66-42d0-a192-ca7ea083341b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:58:41.204948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 429/855] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:58:41 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:58:41.234949 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58824205-57b7-41c6-a591-26514a38901b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:41.270558 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:41.362456 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58824205-57b7-41c6-a591-26514a38901b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:41.398991 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144b2ae-8d2a-4290-b6f0-fe29b613f49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:41.400069 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144b2ae-8d2a-4290-b6f0-fe29b613f49d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:41.400355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144b2ae-8d2a-4290-b6f0-fe29b613f49d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:41.400632 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144b2ae-8d2a-4290-b6f0-fe29b613f49d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:41.415300 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144b2ae-8d2a-4290-b6f0-fe29b613f49d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:58:41.423049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-8144b2ae-8d2a-4290-b6f0-fe29b613f49d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:58:41.423049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:41.423049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:41.423049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:41.423049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:41.423049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:41.423049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:41.423049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:41.423049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:41.423049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:41.423049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:41.423049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:41.423049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:58:41.423049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:58:41.423049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:58:41.423049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:58:41.424205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:58:41.424205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:58:41.424205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:58:41.424205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:58:41.424205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:41.424205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:41.424205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:41.424205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:41.424205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:41.424205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:41.424205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:41.424205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:41.424205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:41.424205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:41.424205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:41.424205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:41.425070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:41.425070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:41.425070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:41.425070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:41.425070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:58:41.425070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:58:41.425070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:58:41.425070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:58:41.425070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:58:41.425070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:58:41.425070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 11:58:41.425070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:58:41.425070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 427/856] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Jul 11 11:58:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:58:41.430811 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6198e7-af66-42d0-a192-ca7ea083341b None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:41.478385 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:41.542135 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6198e7-af66-42d0-a192-ca7ea083341b None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:41.580219 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dce284-17e3-4693-becd-c8bd7e8632c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:41.580891 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dce284-17e3-4693-becd-c8bd7e8632c4 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:41.581173 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dce284-17e3-4693-becd-c8bd7e8632c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:41.581448 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dce284-17e3-4693-becd-c8bd7e8632c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:41.582185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dce284-17e3-4693-becd-c8bd7e8632c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:41.582497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dce284-17e3-4693-becd-c8bd7e8632c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:41.584017 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dce284-17e3-4693-becd-c8bd7e8632c4 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:41.592760 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 430/857] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Jul 11 11:58:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:41.599151 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144b2ae-8d2a-4290-b6f0-fe29b613f49d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:41.695050 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:41.712304 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144b2ae-8d2a-4290-b6f0-fe29b613f49d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:41.752778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21cabf-b47b-4266-92a1-16da4ea9bd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:41.753647 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21cabf-b47b-4266-92a1-16da4ea9bd1b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:41.753949 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21cabf-b47b-4266-92a1-16da4ea9bd1b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:41.754221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21cabf-b47b-4266-92a1-16da4ea9bd1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:41.766813 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21cabf-b47b-4266-92a1-16da4ea9bd1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:41.768420 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21cabf-b47b-4266-92a1-16da4ea9bd1b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:41.785796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-7d21cabf-b47b-4266-92a1-16da4ea9bd1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:41.785796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:41.785796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:41.785796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:41.785796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:41.785796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:41.785796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:41.785796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:41.785796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:41.785796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:41.785796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:41.785796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:41.785796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:58:41.785796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:58:41.785796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:41.786964 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:41.787930 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:58:41.787930 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:58:41.787930 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:41.787930 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:58:41.787930 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 428/858] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:41.793865 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dce284-17e3-4693-becd-c8bd7e8632c4 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:41.921112 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dce284-17e3-4693-becd-c8bd7e8632c4 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:41.924823 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:41.965891 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5eecd-f3b8-4760-835e-76230b58c7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:41.966596 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5eecd-f3b8-4760-835e-76230b58c7bf None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:41.967044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5eecd-f3b8-4760-835e-76230b58c7bf None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:41.967432 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5eecd-f3b8-4760-835e-76230b58c7bf None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:41.968385 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5eecd-f3b8-4760-835e-76230b58c7bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:41.968791 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5eecd-f3b8-4760-835e-76230b58c7bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:41.970299 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5eecd-f3b8-4760-835e-76230b58c7bf None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:41.983200 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 431/859] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:41.989685 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21cabf-b47b-4266-92a1-16da4ea9bd1b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:42.097985 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21cabf-b47b-4266-92a1-16da4ea9bd1b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:42.134488 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6d65b-0726-44a6-bbad-6e2c09050422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:42.135329 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6d65b-0726-44a6-bbad-6e2c09050422 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:42.135613 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6d65b-0726-44a6-bbad-6e2c09050422 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:42.135889 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6d65b-0726-44a6-bbad-6e2c09050422 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:42.138676 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:42.143992 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6d65b-0726-44a6-bbad-6e2c09050422 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:42.145767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6d65b-0726-44a6-bbad-6e2c09050422 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:42.160966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-b4b6d65b-0726-44a6-bbad-6e2c09050422 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:58:42.160966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:42.160966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:42.160966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:42.160966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:42.160966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:42.160966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:42.160966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:42.160966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:42.160966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:42.160966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:42.160966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:42.160966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:58:42.160966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:58:42.160966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:58:42.160966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:42.162039 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:42.163967 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:42.163967 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:42.163967 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:58:42.163967 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:58:42.163967 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:58:42.163967 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:58:42.163967 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:58:42.163967 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:58:42.163967 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:58:42.163967 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:58:42.168445 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 429/860] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:58:42.169623 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5eecd-f3b8-4760-835e-76230b58c7bf None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:42.280216 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5eecd-f3b8-4760-835e-76230b58c7bf None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:42.317770 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e596755-b85d-49ca-ae7b-30bb1d712987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:42.318513 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e596755-b85d-49ca-ae7b-30bb1d712987 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:42.318895 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e596755-b85d-49ca-ae7b-30bb1d712987 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:42.319262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e596755-b85d-49ca-ae7b-30bb1d712987 None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:42.319999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e596755-b85d-49ca-ae7b-30bb1d712987 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:42.320380 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e596755-b85d-49ca-ae7b-30bb1d712987 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:42.321895 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e596755-b85d-49ca-ae7b-30bb1d712987 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:42.344577 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 432/861] 10.222.0.25 () {56 vars in 1143 bytes} [Mon Jul 11 11:58:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:42.351144 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6d65b-0726-44a6-bbad-6e2c09050422 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:42.458049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6d65b-0726-44a6-bbad-6e2c09050422 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:42.493511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e684e9-4675-4c8c-b1e3-e845c77ef768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:42.494160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e684e9-4675-4c8c-b1e3-e845c77ef768 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:42.494451 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e684e9-4675-4c8c-b1e3-e845c77ef768 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:42.494754 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e684e9-4675-4c8c-b1e3-e845c77ef768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:42.563117 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:42.571914 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e684e9-4675-4c8c-b1e3-e845c77ef768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:42.573724 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e684e9-4675-4c8c-b1e3-e845c77ef768 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:42.692909 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 430/862] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:58:42 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:58:42.699320 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e596755-b85d-49ca-ae7b-30bb1d712987 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:42.726760 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:42.810123 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e596755-b85d-49ca-ae7b-30bb1d712987 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:42.850663 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bd5c7-eb69-43b8-89ea-198e1e117570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:42.851645 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bd5c7-eb69-43b8-89ea-198e1e117570 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:42.851940 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bd5c7-eb69-43b8-89ea-198e1e117570 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:42.852209 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bd5c7-eb69-43b8-89ea-198e1e117570 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:42.862555 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bd5c7-eb69-43b8-89ea-198e1e117570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:42.864024 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bd5c7-eb69-43b8-89ea-198e1e117570 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:42.884688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-b25bd5c7-eb69-43b8-89ea-198e1e117570 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:42.884688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:42.884688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:42.884688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:42.884688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:42.884688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:42.884688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:42.884688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:42.884688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:42.884688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:42.884688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:42.884688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:42.884688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:58:42.884688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:58:42.884688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:42.885747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:42.886636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:58:42.886636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:58:42.886636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:42.886636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:42.886636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 433/863] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:42.894751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e684e9-4675-4c8c-b1e3-e845c77ef768 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:42.997399 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:43.003857 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e684e9-4675-4c8c-b1e3-e845c77ef768 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:43.043702 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b3f4-6e5b-4dd4-89aa-f04ac7c1f317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:43.044489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b3f4-6e5b-4dd4-89aa-f04ac7c1f317 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:43.044785 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b3f4-6e5b-4dd4-89aa-f04ac7c1f317 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:43.045064 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b3f4-6e5b-4dd4-89aa-f04ac7c1f317 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:43.045853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411b3f4-6e5b-4dd4-89aa-f04ac7c1f317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:43.046195 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411b3f4-6e5b-4dd4-89aa-f04ac7c1f317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:43.047642 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411b3f4-6e5b-4dd4-89aa-f04ac7c1f317 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:43.060312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 431/864] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:43.066280 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bd5c7-eb69-43b8-89ea-198e1e117570 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:43.151923 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:43.181897 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bd5c7-eb69-43b8-89ea-198e1e117570 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:43.218628 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8618d3-50c7-4ff6-8ef8-f48560e2fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:43.219621 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8618d3-50c7-4ff6-8ef8-f48560e2fbcd None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:43.219962 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8618d3-50c7-4ff6-8ef8-f48560e2fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:43.220332 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8618d3-50c7-4ff6-8ef8-f48560e2fbcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:43.229400 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8618d3-50c7-4ff6-8ef8-f48560e2fbcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:43.231092 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8618d3-50c7-4ff6-8ef8-f48560e2fbcd None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:43.249979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-8f8618d3-50c7-4ff6-8ef8-f48560e2fbcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:58:43.249979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:43.249979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:43.249979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:43.249979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:43.249979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:43.249979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:43.249979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:43.249979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:43.249979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:43.249979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:43.249979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:43.249979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:58:43.249979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:58:43.249979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:43.251265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:43.253171 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:58:43.253171 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:58:43.253171 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:58:43.253171 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:58:43.253171 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:58:43.253171 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:58:43.253171 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:58:43.253171 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:43.253171 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 434/865] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:43.257728 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b3f4-6e5b-4dd4-89aa-f04ac7c1f317 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:43.373798 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b3f4-6e5b-4dd4-89aa-f04ac7c1f317 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:43.412969 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa11c8-856a-41d4-9aa4-bfb2fb5a5bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:43.413648 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa11c8-856a-41d4-9aa4-bfb2fb5a5bc7 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:43.413973 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa11c8-856a-41d4-9aa4-bfb2fb5a5bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:43.414330 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa11c8-856a-41d4-9aa4-bfb2fb5a5bc7 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:43.415252 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa11c8-856a-41d4-9aa4-bfb2fb5a5bc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:43.415608 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa11c8-856a-41d4-9aa4-bfb2fb5a5bc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:43.417401 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa11c8-856a-41d4-9aa4-bfb2fb5a5bc7 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:43.431687 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 432/866] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:58:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:58:43.437965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8618d3-50c7-4ff6-8ef8-f48560e2fbcd None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:43.551584 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8618d3-50c7-4ff6-8ef8-f48560e2fbcd None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:43.588664 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b37957-a1e9-406d-b865-86f4efe1dbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:43.589317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b37957-a1e9-406d-b865-86f4efe1dbf7 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:43.589626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b37957-a1e9-406d-b865-86f4efe1dbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:43.589897 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b37957-a1e9-406d-b865-86f4efe1dbf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:43.590740 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b37957-a1e9-406d-b865-86f4efe1dbf7 None admin] RBAC: Adding query filter params (role.id=22d318004ece47b3a0d4d3919bfebdc9, scope.project.id=6e452080fec045788d9bd5dfdb7a3c52, user.id=fc6d2bcfca0a495582d322494b054045) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:43.591047 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b37957-a1e9-406d-b865-86f4efe1dbf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:43.592475 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b37957-a1e9-406d-b865-86f4efe1dbf7 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:43.594340 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:43.599193 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 435/867] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:58:43 2022] GET /identity/v3/role_assignments?user.id=fc6d2bcfca0a495582d322494b054045&scope.project.id=6e452080fec045788d9bd5dfdb7a3c52&role.id=22d318004ece47b3a0d4d3919bfebdc9 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:46.145851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b1d7a-16b2-406c-9d70-e89e02b51e3e None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:46.146471 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b1d7a-16b2-406c-9d70-e89e02b51e3e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:46.146471 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b1d7a-16b2-406c-9d70-e89e02b51e3e None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:46.148233 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 433/868] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:58:46.153972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d9fcc-970b-44db-9d73-1e8545f707dd None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:46.154418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d9fcc-970b-44db-9d73-1e8545f707dd None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:46.154516 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d9fcc-970b-44db-9d73-1e8545f707dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:46.171866 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-739d9fcc-970b-44db-9d73-1e8545f707dd None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:58:46.173063 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-739d9fcc-970b-44db-9d73-1e8545f707dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:58:46.246886 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 436/869] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:58:46 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:58:46.272490 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b1d7a-16b2-406c-9d70-e89e02b51e3e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:46.291350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:46.384130 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b1d7a-16b2-406c-9d70-e89e02b51e3e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:46.419205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce065511-e38c-4350-9dd1-2a026a54ceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:46.420095 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce065511-e38c-4350-9dd1-2a026a54ceb4 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:46.420407 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce065511-e38c-4350-9dd1-2a026a54ceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:46.420770 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce065511-e38c-4350-9dd1-2a026a54ceb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:46.432982 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce065511-e38c-4350-9dd1-2a026a54ceb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:58:46.441517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-ce065511-e38c-4350-9dd1-2a026a54ceb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:58:46.441517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:46.441517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:46.441517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:46.441517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:46.441517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:46.441517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:46.441517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:46.441517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:46.441517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:46.441517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:46.441517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:46.441517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:58:46.441517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:58:46.441517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:58:46.441517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:58:46.442698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:58:46.442698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:58:46.442698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:58:46.442698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:58:46.442698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:46.442698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:46.442698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:46.442698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:46.442698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:46.442698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:46.442698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:46.442698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:46.442698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:46.442698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:46.442698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:46.442698 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:46.443646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:46.443646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:46.443646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:46.443646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:46.443646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:58:46.443646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:58:46.443646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:58:46.443646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:58:46.443646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:58:46.443646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:58:46.443646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:58:46.443646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:58:46.443646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 434/870] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:58:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:46.449185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d9fcc-970b-44db-9d73-1e8545f707dd None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:46.565894 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d9fcc-970b-44db-9d73-1e8545f707dd None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:46.597003 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:46.606771 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939225fa-f072-4295-a2e1-f628adcc9a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:46.607645 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939225fa-f072-4295-a2e1-f628adcc9a85 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:46.607929 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939225fa-f072-4295-a2e1-f628adcc9a85 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:46.608202 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939225fa-f072-4295-a2e1-f628adcc9a85 None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:46.608971 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939225fa-f072-4295-a2e1-f628adcc9a85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:46.609270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939225fa-f072-4295-a2e1-f628adcc9a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:46.610628 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939225fa-f072-4295-a2e1-f628adcc9a85 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:46.620896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 437/871] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:58:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:46.626803 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce065511-e38c-4350-9dd1-2a026a54ceb4 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:46.714202 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:46.741222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce065511-e38c-4350-9dd1-2a026a54ceb4 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:46.780704 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34aff8e-0253-4b8f-8246-06ed56454662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:46.781493 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aff8e-0253-4b8f-8246-06ed56454662 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:46.781779 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aff8e-0253-4b8f-8246-06ed56454662 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:46.782054 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34aff8e-0253-4b8f-8246-06ed56454662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:46.793547 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34aff8e-0253-4b8f-8246-06ed56454662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:46.794985 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34aff8e-0253-4b8f-8246-06ed56454662 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:46.812688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-f34aff8e-0253-4b8f-8246-06ed56454662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:46.812688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:46.812688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:46.812688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:46.812688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:46.812688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:46.812688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:46.812688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:46.812688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:46.812688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:46.812688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:46.812688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:46.812688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:58:46.812688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:58:46.812688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:46.813807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:46.814755 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:58:46.814755 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:58:46.814755 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:46.814755 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:58:46.814755 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 435/872] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:46.822678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939225fa-f072-4295-a2e1-f628adcc9a85 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:46.940708 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939225fa-f072-4295-a2e1-f628adcc9a85 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:46.978666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e8f4c-3979-44cb-8f7f-fa64e4fb15ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:46.979714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e8f4c-3979-44cb-8f7f-fa64e4fb15ad None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:46.980037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e8f4c-3979-44cb-8f7f-fa64e4fb15ad None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:46.980348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e8f4c-3979-44cb-8f7f-fa64e4fb15ad None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:46.981200 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e8f4c-3979-44cb-8f7f-fa64e4fb15ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:46.981524 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e8f4c-3979-44cb-8f7f-fa64e4fb15ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:46.983121 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e8f4c-3979-44cb-8f7f-fa64e4fb15ad None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:46.997977 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 438/873] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 11:58:47.004352 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34aff8e-0253-4b8f-8246-06ed56454662 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:47.115862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34aff8e-0253-4b8f-8246-06ed56454662 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:47.146102 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:47.157712 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de4db9-9149-43ab-a565-1c7bbe7b95ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:47.158920 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de4db9-9149-43ab-a565-1c7bbe7b95ce None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:47.159272 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de4db9-9149-43ab-a565-1c7bbe7b95ce None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:47.159580 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de4db9-9149-43ab-a565-1c7bbe7b95ce None admin] PATH_INFO: `/v3/users/placement` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:47.170745 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de4db9-9149-43ab-a565-1c7bbe7b95ce None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:47.170940 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de4db9-9149-43ab-a565-1c7bbe7b95ce None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:47.187145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-16de4db9-9149-43ab-a565-1c7bbe7b95ce None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:58:47.187145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:47.187145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:47.187145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:47.187145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:47.187145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:47.187145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:47.187145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:47.187145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:47.187145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:47.187145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:47.187145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:47.187145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:58:47.187145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:58:47.187145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:58:47.187145 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:47.188355 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:47.189871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:47.189871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:47.189871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:58:47.189871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:58:47.189871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:58:47.189871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:58:47.189871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:58:47.189871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:58:47.189871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:58:47.189871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:58:47.189871 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 436/874] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:58:47.195240 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e8f4c-3979-44cb-8f7f-fa64e4fb15ad None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:47.252163 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:47.308080 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e8f4c-3979-44cb-8f7f-fa64e4fb15ad None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:47.345133 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6d050-9517-4f5c-8750-3de75f3fc44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:47.345811 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6d050-9517-4f5c-8750-3de75f3fc44f None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:47.346094 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6d050-9517-4f5c-8750-3de75f3fc44f None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:47.346369 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6d050-9517-4f5c-8750-3de75f3fc44f None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:47.347238 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6d050-9517-4f5c-8750-3de75f3fc44f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:47.347551 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6d050-9517-4f5c-8750-3de75f3fc44f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:47.349014 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6d050-9517-4f5c-8750-3de75f3fc44f None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:47.369941 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 439/875] 10.222.0.25 () {56 vars in 1143 bytes} [Mon Jul 11 11:58:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:47.375929 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de4db9-9149-43ab-a565-1c7bbe7b95ce None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:47.484095 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de4db9-9149-43ab-a565-1c7bbe7b95ce None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:47.519848 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985ecc6-5724-474e-ab58-6ddb863a9c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:47.520419 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985ecc6-5724-474e-ab58-6ddb863a9c7b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:47.520702 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985ecc6-5724-474e-ab58-6ddb863a9c7b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:47.520976 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985ecc6-5724-474e-ab58-6ddb863a9c7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:47.581001 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:47.594358 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985ecc6-5724-474e-ab58-6ddb863a9c7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:47.595880 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985ecc6-5724-474e-ab58-6ddb863a9c7b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:47.698755 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 437/876] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:58:47 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:58:47.704717 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6d050-9517-4f5c-8750-3de75f3fc44f None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:47.805575 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6d050-9517-4f5c-8750-3de75f3fc44f None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:47.814852 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:47.844525 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c9ae1-3e31-4159-8a8f-3d3449e3b17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:47.845666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c9ae1-3e31-4159-8a8f-3d3449e3b17e None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:47.846080 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c9ae1-3e31-4159-8a8f-3d3449e3b17e None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:47.846429 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c9ae1-3e31-4159-8a8f-3d3449e3b17e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:47.859607 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c9ae1-3e31-4159-8a8f-3d3449e3b17e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:47.861429 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c9ae1-3e31-4159-8a8f-3d3449e3b17e None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:47.885061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-0a8c9ae1-3e31-4159-8a8f-3d3449e3b17e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:47.885061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:47.885061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:47.885061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:47.885061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:47.885061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:47.885061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:47.885061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:47.885061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:47.885061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:47.885061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:47.885061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:47.885061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:58:47.885061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:58:47.885061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:47.886090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:47.886996 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:58:47.886996 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:58:47.886996 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:47.886996 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:47.886996 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 440/877] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 11:58:47.892789 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985ecc6-5724-474e-ab58-6ddb863a9c7b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:47.986116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:47.999061 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985ecc6-5724-474e-ab58-6ddb863a9c7b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:48.031699 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf199ee-40b9-4cc4-8f22-014f2893bb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:48.032346 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf199ee-40b9-4cc4-8f22-014f2893bb6e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:48.032629 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf199ee-40b9-4cc4-8f22-014f2893bb6e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:48.032907 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf199ee-40b9-4cc4-8f22-014f2893bb6e None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:48.033617 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf199ee-40b9-4cc4-8f22-014f2893bb6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:48.033951 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf199ee-40b9-4cc4-8f22-014f2893bb6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:48.035351 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf199ee-40b9-4cc4-8f22-014f2893bb6e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:48.046782 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 438/878] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:48.052581 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c9ae1-3e31-4159-8a8f-3d3449e3b17e None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:48.148954 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c9ae1-3e31-4159-8a8f-3d3449e3b17e None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:48.183001 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53abc04-8bd6-4eef-83e0-631c7f86be76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:48.183792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53abc04-8bd6-4eef-83e0-631c7f86be76 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:48.184073 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53abc04-8bd6-4eef-83e0-631c7f86be76 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:48.184345 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53abc04-8bd6-4eef-83e0-631c7f86be76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:48.190944 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53abc04-8bd6-4eef-83e0-631c7f86be76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:48.192383 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53abc04-8bd6-4eef-83e0-631c7f86be76 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:48.206007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-d53abc04-8bd6-4eef-83e0-631c7f86be76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:58:48.206007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:48.206007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:48.206007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:48.206007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:48.206007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:48.206007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:48.206007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:48.206007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:48.206007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:48.206007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:48.206007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:48.206007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:58:48.206007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:58:48.206007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:48.207437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:48.208311 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:58:48.208311 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:58:48.208311 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:58:48.208311 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:58:48.208311 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:58:48.208311 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:58:48.208311 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:58:48.208311 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:48.208311 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 441/879] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:58:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:48.213227 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf199ee-40b9-4cc4-8f22-014f2893bb6e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:48.310901 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf199ee-40b9-4cc4-8f22-014f2893bb6e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:48.343290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaafe31-33bd-4155-bf5b-f1d63d5839c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:48.343924 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaafe31-33bd-4155-bf5b-f1d63d5839c1 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:48.344201 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaafe31-33bd-4155-bf5b-f1d63d5839c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:48.344474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaafe31-33bd-4155-bf5b-f1d63d5839c1 None admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:48.345258 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaafe31-33bd-4155-bf5b-f1d63d5839c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:48.345562 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaafe31-33bd-4155-bf5b-f1d63d5839c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:48.347004 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaafe31-33bd-4155-bf5b-f1d63d5839c1 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:48.359859 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 439/880] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:58:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:48.365833 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53abc04-8bd6-4eef-83e0-631c7f86be76 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:48.387400 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:48.463491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53abc04-8bd6-4eef-83e0-631c7f86be76 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:48.497768 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f155b91-f5d1-41e7-a874-4d47565eb8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:48.498416 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f155b91-f5d1-41e7-a874-4d47565eb8de None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:48.498699 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f155b91-f5d1-41e7-a874-4d47565eb8de None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:48.499007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f155b91-f5d1-41e7-a874-4d47565eb8de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:48.499822 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f155b91-f5d1-41e7-a874-4d47565eb8de None admin] RBAC: Adding query filter params (role.id=11fc9dc7c3664b2b8af8eee2462707b8, scope.project.id=6e452080fec045788d9bd5dfdb7a3c52, user.id=fc6d2bcfca0a495582d322494b054045) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:48.500131 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f155b91-f5d1-41e7-a874-4d47565eb8de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:48.501552 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f155b91-f5d1-41e7-a874-4d47565eb8de None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:48.507054 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 442/881] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:58:48 2022] GET /identity/v3/role_assignments?user.id=fc6d2bcfca0a495582d322494b054045&scope.project.id=6e452080fec045788d9bd5dfdb7a3c52&role.id=11fc9dc7c3664b2b8af8eee2462707b8 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:50.691288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7961eb-4014-4bfe-94c4-2b5db9397795 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:50.691849 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7961eb-4014-4bfe-94c4-2b5db9397795 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:50.691849 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7961eb-4014-4bfe-94c4-2b5db9397795 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:50.693190 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 440/882] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:58:50.699901 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1cdd4-837e-46a0-a5ba-763c0f73dd8b None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:50.700304 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1cdd4-837e-46a0-a5ba-763c0f73dd8b None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:50.700448 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1cdd4-837e-46a0-a5ba-763c0f73dd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:50.717249 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-dad1cdd4-837e-46a0-a5ba-763c0f73dd8b None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:58:50.718439 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-dad1cdd4-837e-46a0-a5ba-763c0f73dd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:58:50.783507 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 443/883] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:58:50 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:58:50.807200 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7961eb-4014-4bfe-94c4-2b5db9397795 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:50.817854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:50.922177 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7961eb-4014-4bfe-94c4-2b5db9397795 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:50.955654 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb05219-9acc-4996-9857-6a7e60f4ed35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:50.956363 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb05219-9acc-4996-9857-6a7e60f4ed35 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:50.956644 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb05219-9acc-4996-9857-6a7e60f4ed35 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:50.956916 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb05219-9acc-4996-9857-6a7e60f4ed35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:50.968402 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb05219-9acc-4996-9857-6a7e60f4ed35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:58:50.977132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-7bb05219-9acc-4996-9857-6a7e60f4ed35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:58:50.977132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:50.977132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:50.977132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:50.977132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:50.977132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:50.977132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:50.977132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:50.977132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:50.977132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:50.977132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:50.977132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:50.977132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:58:50.977132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:58:50.977132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:58:50.977132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:58:50.978303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:58:50.978303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:58:50.978303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:58:50.978303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:58:50.978303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:50.978303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:50.978303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:50.978303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:50.978303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:50.978303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:50.978303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:50.978303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:50.978303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:50.978303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:50.978303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:50.978303 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:50.984524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:50.984524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:50.984524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:50.984524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:50.984524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:58:50.984524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:58:50.984524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:58:50.984524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:58:50.984524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:58:50.984524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:58:50.984524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:58:50.984524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:58:50.984524 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 441/884] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:58:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:50.985376 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1cdd4-837e-46a0-a5ba-763c0f73dd8b None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:50.999953 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:51.081632 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1cdd4-837e-46a0-a5ba-763c0f73dd8b None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:51.114594 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf8958-ffe0-4790-832b-43c94e826e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:51.115935 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf8958-ffe0-4790-832b-43c94e826e6b None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:51.116214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf8958-ffe0-4790-832b-43c94e826e6b None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:51.116486 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf8958-ffe0-4790-832b-43c94e826e6b None admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:51.117216 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf8958-ffe0-4790-832b-43c94e826e6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:51.117518 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf8958-ffe0-4790-832b-43c94e826e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:51.118901 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf8958-ffe0-4790-832b-43c94e826e6b None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:51.126648 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 444/885] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:58:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:51.132323 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb05219-9acc-4996-9857-6a7e60f4ed35 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:51.199289 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:51.233912 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb05219-9acc-4996-9857-6a7e60f4ed35 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:51.267335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9e666-6177-4723-a809-e24a5d079a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:51.268114 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9e666-6177-4723-a809-e24a5d079a00 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:51.268397 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9e666-6177-4723-a809-e24a5d079a00 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:51.268673 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9e666-6177-4723-a809-e24a5d079a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:51.279542 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9e666-6177-4723-a809-e24a5d079a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:51.280987 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9e666-6177-4723-a809-e24a5d079a00 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:51.297633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-ffa9e666-6177-4723-a809-e24a5d079a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:51.297633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:51.297633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:51.297633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:51.297633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:51.297633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:51.297633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:51.297633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:51.297633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:51.297633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:51.297633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:51.297633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:51.297633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:58:51.297633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:58:51.297633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:51.298593 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:51.299844 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:58:51.299844 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:58:51.299844 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:51.299844 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:58:51.299844 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 442/886] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:51.305416 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf8958-ffe0-4790-832b-43c94e826e6b None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:51.381980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:51.404547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf8958-ffe0-4790-832b-43c94e826e6b None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:51.436678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc28cd3-5203-4a5d-9602-a7dfd66f7564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:51.437322 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc28cd3-5203-4a5d-9602-a7dfd66f7564 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:51.437600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc28cd3-5203-4a5d-9602-a7dfd66f7564 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:51.437872 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc28cd3-5203-4a5d-9602-a7dfd66f7564 None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:51.438578 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc28cd3-5203-4a5d-9602-a7dfd66f7564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:51.438907 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc28cd3-5203-4a5d-9602-a7dfd66f7564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:51.440263 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc28cd3-5203-4a5d-9602-a7dfd66f7564 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:51.452171 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 445/887] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:51.457773 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9e666-6177-4723-a809-e24a5d079a00 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:51.555187 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9e666-6177-4723-a809-e24a5d079a00 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:51.574465 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:51.588314 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383ad4b-f571-44ee-8cdd-408552ff63a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:51.589280 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383ad4b-f571-44ee-8cdd-408552ff63a7 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:51.589604 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383ad4b-f571-44ee-8cdd-408552ff63a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:51.589881 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383ad4b-f571-44ee-8cdd-408552ff63a7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:51.599916 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383ad4b-f571-44ee-8cdd-408552ff63a7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:51.601805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383ad4b-f571-44ee-8cdd-408552ff63a7 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:51.617412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-3383ad4b-f571-44ee-8cdd-408552ff63a7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:58:51.617412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:51.617412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:51.617412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:51.617412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:51.617412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:51.617412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:51.617412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:51.617412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:51.617412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:51.617412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:51.617412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:51.617412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:58:51.617412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:58:51.617412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:58:51.617412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:51.618506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:51.619532 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:51.619532 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:51.619532 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:58:51.619532 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:58:51.619532 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:58:51.619532 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:58:51.619532 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:58:51.619532 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:58:51.619532 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:58:51.619532 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:58:51.619532 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 443/888] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:51.624540 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc28cd3-5203-4a5d-9602-a7dfd66f7564 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:51.719846 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc28cd3-5203-4a5d-9602-a7dfd66f7564 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:51.753248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666b20d-a4c5-4d56-9893-f92268bd872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:51.753901 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666b20d-a4c5-4d56-9893-f92268bd872e None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:51.754182 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666b20d-a4c5-4d56-9893-f92268bd872e None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:51.754452 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666b20d-a4c5-4d56-9893-f92268bd872e None admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:51.755289 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666b20d-a4c5-4d56-9893-f92268bd872e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:51.755595 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666b20d-a4c5-4d56-9893-f92268bd872e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:51.757036 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666b20d-a4c5-4d56-9893-f92268bd872e None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:51.759491 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:51.773762 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 446/889] 10.222.0.25 () {56 vars in 1143 bytes} [Mon Jul 11 11:58:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:51.779490 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383ad4b-f571-44ee-8cdd-408552ff63a7 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:51.885363 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383ad4b-f571-44ee-8cdd-408552ff63a7 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:51.917839 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad492a43-a48d-4769-b9f7-92c61839ab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:51.918616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492a43-a48d-4769-b9f7-92c61839ab08 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:51.918939 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492a43-a48d-4769-b9f7-92c61839ab08 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:51.919217 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492a43-a48d-4769-b9f7-92c61839ab08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:51.930239 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad492a43-a48d-4769-b9f7-92c61839ab08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:51.931713 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad492a43-a48d-4769-b9f7-92c61839ab08 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:51.948817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-ad492a43-a48d-4769-b9f7-92c61839ab08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:51.948817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:51.948817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:51.948817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:51.948817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:51.948817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:51.948817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:51.948817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:51.948817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:51.948817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:51.948817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:51.948817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:51.948817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:58:51.948817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:58:51.948817 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:51.949869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:51.951077 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:58:51.951077 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:58:51.951077 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:51.951077 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:58:51.951077 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 444/890] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:51.955910 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666b20d-a4c5-4d56-9893-f92268bd872e None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:52.055215 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666b20d-a4c5-4d56-9893-f92268bd872e None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:52.087769 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cbcc5-9671-4fb7-9261-610a0fd404bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:52.088423 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cbcc5-9671-4fb7-9261-610a0fd404bc None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:52.088718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cbcc5-9671-4fb7-9261-610a0fd404bc None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:52.088991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cbcc5-9671-4fb7-9261-610a0fd404bc None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:52.089701 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cbcc5-9671-4fb7-9261-610a0fd404bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:52.090006 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cbcc5-9671-4fb7-9261-610a0fd404bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:52.091403 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cbcc5-9671-4fb7-9261-610a0fd404bc None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:52.103119 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 447/891] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:52.108731 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad492a43-a48d-4769-b9f7-92c61839ab08 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:52.139354 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:52.209122 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad492a43-a48d-4769-b9f7-92c61839ab08 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:52.242249 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278478b-4634-4c6e-80da-5a246dcebf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:52.243057 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278478b-4634-4c6e-80da-5a246dcebf10 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:52.243342 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278478b-4634-4c6e-80da-5a246dcebf10 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:52.243618 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278478b-4634-4c6e-80da-5a246dcebf10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:52.250133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278478b-4634-4c6e-80da-5a246dcebf10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:52.251606 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278478b-4634-4c6e-80da-5a246dcebf10 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:52.266203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-a278478b-4634-4c6e-80da-5a246dcebf10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:58:52.266203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:52.266203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:52.266203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:52.266203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:52.266203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:52.266203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:52.266203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:52.266203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:52.266203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:52.266203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:52.266203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:52.266203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:58:52.266203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:58:52.266203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:52.267288 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:52.268218 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:58:52.268218 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:58:52.268218 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:58:52.268218 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:58:52.268218 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:58:52.268218 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:58:52.268218 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:58:52.268218 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:58:52.268218 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 445/892] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:58:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:52.273863 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cbcc5-9671-4fb7-9261-610a0fd404bc None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:52.328986 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:52.373949 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cbcc5-9671-4fb7-9261-610a0fd404bc None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:52.407469 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c972079-003a-47fe-984a-6242b4c7c8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:52.408062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c972079-003a-47fe-984a-6242b4c7c8b0 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:52.408348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c972079-003a-47fe-984a-6242b4c7c8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:52.408624 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c972079-003a-47fe-984a-6242b4c7c8b0 None admin] PATH_INFO: `/v3/projects` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:52.409420 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c972079-003a-47fe-984a-6242b4c7c8b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:52.409718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c972079-003a-47fe-984a-6242b4c7c8b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:52.411192 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c972079-003a-47fe-984a-6242b4c7c8b0 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:52.423084 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 448/893] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:58:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:52.428956 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278478b-4634-4c6e-80da-5a246dcebf10 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:52.518955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:52.528595 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278478b-4634-4c6e-80da-5a246dcebf10 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:52.561837 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5295dd-7642-4883-9cab-929ba0c88ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:52.562704 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5295dd-7642-4883-9cab-929ba0c88ba4 None admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:52.563014 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5295dd-7642-4883-9cab-929ba0c88ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:52.563285 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5295dd-7642-4883-9cab-929ba0c88ba4 None admin] PATH_INFO: `/v3/projects/6e452080fec045788d9bd5dfdb7a3c52/users/fc6d2bcfca0a495582d322494b054045/roles/11fc9dc7c3664b2b8af8eee2462707b8` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:52.565517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5295dd-7642-4883-9cab-929ba0c88ba4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e452080fec045788d9bd5dfdb7a3c52, user_id=fc6d2bcfca0a495582d322494b054045, role_id=11fc9dc7c3664b2b8af8eee2462707b8)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:52.566982 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5295dd-7642-4883-9cab-929ba0c88ba4 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:52.579500 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 446/894] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Jul 11 11:58:52 2022] PUT /identity/v3/projects/6e452080fec045788d9bd5dfdb7a3c52/users/fc6d2bcfca0a495582d322494b054045/roles/11fc9dc7c3664b2b8af8eee2462707b8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 11:58:54.824305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c89d9-486c-4b65-813f-43acd5895a0f None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:54.824849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c89d9-486c-4b65-813f-43acd5895a0f None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:54.824849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c89d9-486c-4b65-813f-43acd5895a0f None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:54.826280 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 449/895] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 11:58:54.832561 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac4993-f90c-4b61-88cb-ab102b0562f6 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:54.833143 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac4993-f90c-4b61-88cb-ab102b0562f6 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:54.833143 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac4993-f90c-4b61-88cb-ab102b0562f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:54.852281 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-6aac4993-f90c-4b61-88cb-ab102b0562f6 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:58:54.853739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6aac4993-f90c-4b61-88cb-ab102b0562f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:58:54.927246 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 447/896] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:58:54 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:58:54.952207 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c89d9-486c-4b65-813f-43acd5895a0f None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:55.054007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c89d9-486c-4b65-813f-43acd5895a0f None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:55.068417 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:55.088771 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a24b7-b5bd-404d-ba65-8c13b8afe0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:55.089498 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a24b7-b5bd-404d-ba65-8c13b8afe0e6 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:55.089784 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a24b7-b5bd-404d-ba65-8c13b8afe0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:55.090060 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a24b7-b5bd-404d-ba65-8c13b8afe0e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:55.101309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a24b7-b5bd-404d-ba65-8c13b8afe0e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 11:58:55.108925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-041a24b7-b5bd-404d-ba65-8c13b8afe0e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:58:55.108925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:55.108925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:55.108925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:55.108925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:55.108925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:55.108925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:55.108925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:55.108925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:55.108925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:55.108925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:55.108925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:55.108925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 11:58:55.108925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 11:58:55.108925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 11:58:55.108925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 11:58:55.109973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 11:58:55.109973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 11:58:55.109973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 11:58:55.109973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 11:58:55.109973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:55.109973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:55.109973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:55.109973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:55.109973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:55.109973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:55.109973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:55.109973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:55.109973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:55.109973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:55.109973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:55.109973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:55.110838 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:55.110838 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:55.110838 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:55.110838 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:55.110838 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 11:58:55.110838 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 11:58:55.110838 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 11:58:55.110838 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 11:58:55.110838 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 11:58:55.110838 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 11:58:55.110838 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 11:58:55.110838 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:55.110838 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 450/897] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Jul 11 11:58:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:55.116579 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac4993-f90c-4b61-88cb-ab102b0562f6 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:55.198916 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:55.218485 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac4993-f90c-4b61-88cb-ab102b0562f6 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:55.253316 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f636295-a6cd-4033-96b6-70f63ab1930e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:55.253974 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f636295-a6cd-4033-96b6-70f63ab1930e None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:55.254258 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f636295-a6cd-4033-96b6-70f63ab1930e None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:55.254538 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f636295-a6cd-4033-96b6-70f63ab1930e None admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:55.255307 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f636295-a6cd-4033-96b6-70f63ab1930e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:55.255640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f636295-a6cd-4033-96b6-70f63ab1930e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:55.257534 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f636295-a6cd-4033-96b6-70f63ab1930e None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:55.265441 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 448/898] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Jul 11 11:58:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:55.271113 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a24b7-b5bd-404d-ba65-8c13b8afe0e6 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:55.368705 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a24b7-b5bd-404d-ba65-8c13b8afe0e6 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:55.401583 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db3853-70c2-4291-883e-f1d4a56f9cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:55.402353 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db3853-70c2-4291-883e-f1d4a56f9cf8 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:55.402631 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db3853-70c2-4291-883e-f1d4a56f9cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:55.402929 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db3853-70c2-4291-883e-f1d4a56f9cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:55.413341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db3853-70c2-4291-883e-f1d4a56f9cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:55.414804 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db3853-70c2-4291-883e-f1d4a56f9cf8 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:55.431333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-75db3853-70c2-4291-883e-f1d4a56f9cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:55.431333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:55.431333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:55.431333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:55.431333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:55.431333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:55.431333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:55.431333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:55.431333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:55.431333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:55.431333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:55.431333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:55.431333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:58:55.431333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:58:55.431333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:55.432262 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:55.433156 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:58:55.433156 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:58:55.433156 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:55.433156 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:55.433156 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 451/899] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:55.438683 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f636295-a6cd-4033-96b6-70f63ab1930e None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:55.540196 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f636295-a6cd-4033-96b6-70f63ab1930e None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:55.573720 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b0fd9-ab9b-40a8-a1e7-472ac17a8bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:55.574365 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b0fd9-ab9b-40a8-a1e7-472ac17a8bd5 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:55.574650 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b0fd9-ab9b-40a8-a1e7-472ac17a8bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:55.574955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b0fd9-ab9b-40a8-a1e7-472ac17a8bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:55.575665 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b0fd9-ab9b-40a8-a1e7-472ac17a8bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:55.575973 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b0fd9-ab9b-40a8-a1e7-472ac17a8bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:55.577337 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b0fd9-ab9b-40a8-a1e7-472ac17a8bd5 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:55.589473 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 449/900] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:55.595466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db3853-70c2-4291-883e-f1d4a56f9cf8 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:55.627780 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:55.698616 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db3853-70c2-4291-883e-f1d4a56f9cf8 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:55.731110 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdd2ae-d2ae-4684-9ecc-aa14d375b342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:55.731894 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdd2ae-d2ae-4684-9ecc-aa14d375b342 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:55.732174 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdd2ae-d2ae-4684-9ecc-aa14d375b342 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:55.732445 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdd2ae-d2ae-4684-9ecc-aa14d375b342 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:55.739569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdd2ae-d2ae-4684-9ecc-aa14d375b342 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:55.741662 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdd2ae-d2ae-4684-9ecc-aa14d375b342 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:55.755509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-2dcdd2ae-d2ae-4684-9ecc-aa14d375b342 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:58:55.755509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:55.755509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:55.755509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:55.755509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:55.755509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:55.755509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:55.755509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:55.755509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:55.755509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:55.755509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:55.755509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:55.755509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 11:58:55.755509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 11:58:55.755509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 11:58:55.755509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:55.756666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:55.757751 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:55.757751 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:55.757751 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 11:58:55.757751 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 11:58:55.757751 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 11:58:55.757751 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 11:58:55.757751 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 11:58:55.757751 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 11:58:55.757751 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 11:58:55.757751 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:55.757751 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 452/901] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:55.762737 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b0fd9-ab9b-40a8-a1e7-472ac17a8bd5 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:55.766455 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:55.865801 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b0fd9-ab9b-40a8-a1e7-472ac17a8bd5 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:55.898903 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d971a98-a0cc-4574-bacb-31e5bf5e498a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:55.899501 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d971a98-a0cc-4574-bacb-31e5bf5e498a None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:55.899787 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d971a98-a0cc-4574-bacb-31e5bf5e498a None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:55.900065 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d971a98-a0cc-4574-bacb-31e5bf5e498a None admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:55.900885 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d971a98-a0cc-4574-bacb-31e5bf5e498a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:55.901195 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d971a98-a0cc-4574-bacb-31e5bf5e498a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:55.902623 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d971a98-a0cc-4574-bacb-31e5bf5e498a None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:55.919657 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 450/902] 10.222.0.25 () {56 vars in 1143 bytes} [Mon Jul 11 11:58:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:55.925307 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdd2ae-d2ae-4684-9ecc-aa14d375b342 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:56.012674 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:56.028380 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdd2ae-d2ae-4684-9ecc-aa14d375b342 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:56.060883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef8c49-72f8-4b0e-b0e5-b8ce73b70a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:56.061521 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef8c49-72f8-4b0e-b0e5-b8ce73b70a60 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:56.061804 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef8c49-72f8-4b0e-b0e5-b8ce73b70a60 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:56.062085 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef8c49-72f8-4b0e-b0e5-b8ce73b70a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:56.126991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef8c49-72f8-4b0e-b0e5-b8ce73b70a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:56.128431 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef8c49-72f8-4b0e-b0e5-b8ce73b70a60 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:56.212150 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:56.228076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 453/903] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Jul 11 11:58:55 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 11:58:56.233841 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d971a98-a0cc-4574-bacb-31e5bf5e498a None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:56.297381 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:56.335818 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d971a98-a0cc-4574-bacb-31e5bf5e498a None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:56.368782 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01392c61-2f1e-4742-b4d7-7360900ebc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:56.369556 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01392c61-2f1e-4742-b4d7-7360900ebc5b None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:56.369835 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01392c61-2f1e-4742-b4d7-7360900ebc5b None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:56.370112 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01392c61-2f1e-4742-b4d7-7360900ebc5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:56.379936 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01392c61-2f1e-4742-b4d7-7360900ebc5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:56.381942 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01392c61-2f1e-4742-b4d7-7360900ebc5b None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:56.399523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-01392c61-2f1e-4742-b4d7-7360900ebc5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:56.399523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:56.399523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:56.399523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:56.399523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:56.399523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:56.399523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:56.399523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:56.399523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:56.399523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:56.399523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:56.399523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:56.399523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 11:58:56.399523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 11:58:56.399523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:56.400519 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:56.401599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 11:58:56.401599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 11:58:56.401599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 11:58:56.401599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:58:56.401599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 451/904] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 11:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:56.406388 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef8c49-72f8-4b0e-b0e5-b8ce73b70a60 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:56.503997 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef8c49-72f8-4b0e-b0e5-b8ce73b70a60 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:56.537475 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fe39f-53cc-4d80-8107-3965f39475c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:56.538121 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fe39f-53cc-4d80-8107-3965f39475c7 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:56.538401 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fe39f-53cc-4d80-8107-3965f39475c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:56.538673 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fe39f-53cc-4d80-8107-3965f39475c7 None admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:56.539416 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fe39f-53cc-4d80-8107-3965f39475c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:56.539717 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fe39f-53cc-4d80-8107-3965f39475c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:56.541063 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fe39f-53cc-4d80-8107-3965f39475c7 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:56.551919 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 454/905] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Jul 11 11:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:56.557994 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01392c61-2f1e-4742-b4d7-7360900ebc5b None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:56.661430 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01392c61-2f1e-4742-b4d7-7360900ebc5b None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:56.676349 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:56.699321 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fe6eb-6615-46e7-b4fc-7ba1abdd447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:56.700107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fe6eb-6615-46e7-b4fc-7ba1abdd447d None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:56.700395 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fe6eb-6615-46e7-b4fc-7ba1abdd447d None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:56.700673 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fe6eb-6615-46e7-b4fc-7ba1abdd447d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:56.707470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fe6eb-6615-46e7-b4fc-7ba1abdd447d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:56.709030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fe6eb-6615-46e7-b4fc-7ba1abdd447d None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:56.722919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application [None req-e80fe6eb-6615-46e7-b4fc-7ba1abdd447d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:58:56.722919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:56.722919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:56.722919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:56.722919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:56.722919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:56.722919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:56.722919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:56.722919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:56.722919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:56.722919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:56.722919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:56.722919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 11:58:56.722919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 11:58:56.722919 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:56.723786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:56.729669 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 11:58:56.729669 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 11:58:56.729669 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 11:58:56.729669 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 11:58:56.729669 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 11:58:56.729669 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 11:58:56.729669 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 11:58:56.729669 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: ERROR keystone.server.flask.application Jul 11 11:58:56.729669 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 452/906] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Jul 11 11:58:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:56.731421 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fe39f-53cc-4d80-8107-3965f39475c7 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:56.780560 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:56.839956 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fe39f-53cc-4d80-8107-3965f39475c7 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:56.874084 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cac3af-1675-4eae-b1f3-61bbafdc0229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:56.874792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac3af-1675-4eae-b1f3-61bbafdc0229 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:56.875077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac3af-1675-4eae-b1f3-61bbafdc0229 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:56.875352 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cac3af-1675-4eae-b1f3-61bbafdc0229 None admin] PATH_INFO: `/v3/projects` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:56.876132 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cac3af-1675-4eae-b1f3-61bbafdc0229 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:56.876458 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cac3af-1675-4eae-b1f3-61bbafdc0229 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:56.877885 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cac3af-1675-4eae-b1f3-61bbafdc0229 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:56.890142 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 455/907] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Jul 11 11:58:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:56.896142 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fe6eb-6615-46e7-b4fc-7ba1abdd447d None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:56.995040 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fe6eb-6615-46e7-b4fc-7ba1abdd447d None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:57.027909 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56df3b-27e8-4de1-a946-fa32d0b1b851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:57.028546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56df3b-27e8-4de1-a946-fa32d0b1b851 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:57.028827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56df3b-27e8-4de1-a946-fa32d0b1b851 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:57.029099 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56df3b-27e8-4de1-a946-fa32d0b1b851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:57.029904 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56df3b-27e8-4de1-a946-fa32d0b1b851 None admin] RBAC: Adding query filter params (role.id=11fc9dc7c3664b2b8af8eee2462707b8, scope.project.id=6e452080fec045788d9bd5dfdb7a3c52, user.id=fc6d2bcfca0a495582d322494b054045) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:57.030210 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56df3b-27e8-4de1-a946-fa32d0b1b851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:57.031713 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56df3b-27e8-4de1-a946-fa32d0b1b851 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:57.038012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 453/908] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Jul 11 11:58:56 2022] GET /identity/v3/role_assignments?user.id=fc6d2bcfca0a495582d322494b054045&scope.project.id=6e452080fec045788d9bd5dfdb7a3c52&role.id=11fc9dc7c3664b2b8af8eee2462707b8 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:59.323844 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204e44f-ad8e-458a-a971-37761f116943 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:59.324382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204e44f-ad8e-458a-a971-37761f116943 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:59.324382 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204e44f-ad8e-458a-a971-37761f116943 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:59.325753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 456/909] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:58:59.330858 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9bd0a-bfa9-4b12-88d1-612f605d6189 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:59.331290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9bd0a-bfa9-4b12-88d1-612f605d6189 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:59.331412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9bd0a-bfa9-4b12-88d1-612f605d6189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:59.348714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c5a9bd0a-bfa9-4b12-88d1-612f605d6189 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:58:59.350068 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c5a9bd0a-bfa9-4b12-88d1-612f605d6189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:58:59.378400 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:59.415370 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 454/910] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:58:59 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:58:59.439118 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204e44f-ad8e-458a-a971-37761f116943 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:59.537624 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204e44f-ad8e-458a-a971-37761f116943 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:59.544739 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:58:59.574123 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd475d5-a03d-4170-9d9b-db7642dc7d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:59.574931 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd475d5-a03d-4170-9d9b-db7642dc7d80 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:59.575215 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd475d5-a03d-4170-9d9b-db7642dc7d80 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:59.575486 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd475d5-a03d-4170-9d9b-db7642dc7d80 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:59.576121 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd475d5-a03d-4170-9d9b-db7642dc7d80 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:59.577474 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd475d5-a03d-4170-9d9b-db7642dc7d80 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-6cd475d5-a03d-4170-9d9b-db7642dc7d80 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:58:59.589138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:58:59.590341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:58:59.590341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:58:59.590341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:58:59.590341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:58:59.590341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:58:59.590341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:58:59.590341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:58:59.590341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:58:59.590341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:58:59.590341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:58:59.590341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:58:59.590341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:58:59.590341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:58:59.590341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:58:59.590341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:58:59.590341 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:58:59.591270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:58:59.591270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:58:59.591270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:58:59.591270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:58:59.591270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:58:59.591270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:58:59.591270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:58:59.591270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:58:59.591270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:58:59.591270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:58:59.591270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:58:59.591270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:58:59.591270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:58:59.591270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:58:59.591270 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 457/911] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Jul 11 11:58:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:58:59.596297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9bd0a-bfa9-4b12-88d1-612f605d6189 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:59.693918 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9bd0a-bfa9-4b12-88d1-612f605d6189 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:59.726147 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265dce5-5466-4c9c-9e5b-140946f01071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:59.726831 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265dce5-5466-4c9c-9e5b-140946f01071 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:59.727111 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265dce5-5466-4c9c-9e5b-140946f01071 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:59.727382 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265dce5-5466-4c9c-9e5b-140946f01071 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:59.728070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265dce5-5466-4c9c-9e5b-140946f01071 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:59.728370 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265dce5-5466-4c9c-9e5b-140946f01071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:59.729728 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265dce5-5466-4c9c-9e5b-140946f01071 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:59.734362 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 455/912] 10.222.0.25 () {56 vars in 1116 bytes} [Mon Jul 11 11:58:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:58:59.740722 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd475d5-a03d-4170-9d9b-db7642dc7d80 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:58:59.839029 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd475d5-a03d-4170-9d9b-db7642dc7d80 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:58:59.882691 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71e804-e909-4234-8c44-edf9ba213477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:58:59.883535 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71e804-e909-4234-8c44-edf9ba213477 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:58:59.883915 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71e804-e909-4234-8c44-edf9ba213477 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:58:59.884133 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71e804-e909-4234-8c44-edf9ba213477 None admin] PATH_INFO: `/v3/services` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:58:59.884990 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71e804-e909-4234-8c44-edf9ba213477 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:58:59.885425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71e804-e909-4234-8c44-edf9ba213477 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:58:59.887132 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71e804-e909-4234-8c44-edf9ba213477 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:58:59.892161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 458/913] 10.222.0.25 () {56 vars in 1116 bytes} [Mon Jul 11 11:58:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:59:02.107414 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626443f2-cfb8-4e72-afc1-5c5556665ad9 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:59:02.107970 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626443f2-cfb8-4e72-afc1-5c5556665ad9 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:59:02.107970 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626443f2-cfb8-4e72-afc1-5c5556665ad9 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:59:02.109336 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 456/914] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:59:02.114330 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64def1-b64f-482b-a58d-49351a58dc20 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:59:02.114802 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64def1-b64f-482b-a58d-49351a58dc20 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:59:02.114939 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64def1-b64f-482b-a58d-49351a58dc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:59:02.132051 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-1e64def1-b64f-482b-a58d-49351a58dc20 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:59:02.133215 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-1e64def1-b64f-482b-a58d-49351a58dc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:59:02.159451 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:02.200572 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 459/915] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:59:02 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:59:02.224737 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626443f2-cfb8-4e72-afc1-5c5556665ad9 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:59:02.255914 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:02.326141 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626443f2-cfb8-4e72-afc1-5c5556665ad9 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:59:02.360037 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb73ec-37ec-4a1f-baf9-6b5862574176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:59:02.360620 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb73ec-37ec-4a1f-baf9-6b5862574176 None admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:59:02.360904 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb73ec-37ec-4a1f-baf9-6b5862574176 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:59:02.361182 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb73ec-37ec-4a1f-baf9-6b5862574176 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:59:02.361896 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb73ec-37ec-4a1f-baf9-6b5862574176 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:59:02.363297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb73ec-37ec-4a1f-baf9-6b5862574176 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:59:02.376592 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 457/916] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Jul 11 11:59:02 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:59:04.598636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085296d-2854-449e-ab0a-2b6c5f1c6d64 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:59:04.599325 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085296d-2854-449e-ab0a-2b6c5f1c6d64 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:59:04.599444 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085296d-2854-449e-ab0a-2b6c5f1c6d64 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:59:04.600767 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 460/917] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:59:04.606346 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddaa20-8f09-495c-a6b7-9df19a41e7ec None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:59:04.606802 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddaa20-8f09-495c-a6b7-9df19a41e7ec None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:59:04.606929 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddaa20-8f09-495c-a6b7-9df19a41e7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:59:04.623230 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-28ddaa20-8f09-495c-a6b7-9df19a41e7ec None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:59:04.624394 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-28ddaa20-8f09-495c-a6b7-9df19a41e7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:59:04.695374 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 458/918] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:59:04 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 11:59:04.719558 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085296d-2854-449e-ab0a-2b6c5f1c6d64 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:59:04.818576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085296d-2854-449e-ab0a-2b6c5f1c6d64 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:59:04.860492 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aef8da-d958-462e-b555-aff6c5ec7e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:59:04.861152 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aef8da-d958-462e-b555-aff6c5ec7e47 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:59:04.861435 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aef8da-d958-462e-b555-aff6c5ec7e47 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:59:04.861706 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aef8da-d958-462e-b555-aff6c5ec7e47 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:59:04.862349 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aef8da-d958-462e-b555-aff6c5ec7e47 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:59:04.863752 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aef8da-d958-462e-b555-aff6c5ec7e47 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-50aef8da-d958-462e-b555-aff6c5ec7e47 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:59:04.879405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:59:04.881386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:59:04.881386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:59:04.881386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:59:04.881386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:59:04.881386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:59:04.881386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:59:04.881386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:59:04.881386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:59:04.881386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:59:04.881386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:59:04.881386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:59:04.881386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:59:04.881386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:59:04.881386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:59:04.881386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:59:04.881386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:59:04.882600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:59:04.882600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:59:04.882600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:59:04.882600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:59:04.882600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:59:04.882600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:59:04.882600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:59:04.882600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:59:04.882600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:59:04.882600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:59:04.882600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:59:04.882600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:59:04.882600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:59:04.882600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:59:04.882600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 461/919] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Jul 11 11:59:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:59:04.888549 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddaa20-8f09-495c-a6b7-9df19a41e7ec None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:59:04.907100 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:04.988901 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddaa20-8f09-495c-a6b7-9df19a41e7ec None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:59:05.023670 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9a33d-64b9-4659-a2e9-2321c1b33555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:59:05.024320 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9a33d-64b9-4659-a2e9-2321c1b33555 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:59:05.024604 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9a33d-64b9-4659-a2e9-2321c1b33555 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:59:05.024878 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9a33d-64b9-4659-a2e9-2321c1b33555 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:59:05.025572 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9a33d-64b9-4659-a2e9-2321c1b33555 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:59:05.025880 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9a33d-64b9-4659-a2e9-2321c1b33555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:59:05.027361 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9a33d-64b9-4659-a2e9-2321c1b33555 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:59:05.032325 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 459/920] 10.222.0.25 () {56 vars in 1116 bytes} [Mon Jul 11 11:59:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:59:05.038305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aef8da-d958-462e-b555-aff6c5ec7e47 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:59:05.066230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:05.138786 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aef8da-d958-462e-b555-aff6c5ec7e47 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:59:05.170547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a975d-ce97-4b9c-91b0-21001b8fd88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:59:05.171229 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a975d-ce97-4b9c-91b0-21001b8fd88d None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:59:05.171509 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a975d-ce97-4b9c-91b0-21001b8fd88d None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:59:05.171782 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a975d-ce97-4b9c-91b0-21001b8fd88d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:59:05.172557 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a975d-ce97-4b9c-91b0-21001b8fd88d None admin] RBAC: Adding query filter params (interface=public, service_id=7249ea8a0da040c0925ef4a093e7e96c, region_id=RegionOne) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:59:05.172861 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a975d-ce97-4b9c-91b0-21001b8fd88d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:59:05.174220 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a975d-ce97-4b9c-91b0-21001b8fd88d None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:59:05.180176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 462/921] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Jul 11 11:59:05 2022] GET /identity/v3/endpoints?service_id=7249ea8a0da040c0925ef4a093e7e96c&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:59:05.185762 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9a33d-64b9-4659-a2e9-2321c1b33555 None admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:59:05.265795 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:05.284140 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9a33d-64b9-4659-a2e9-2321c1b33555 None admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:59:05.319105 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409b19f-f6d0-4ba1-a299-67af8c9b96c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:59:05.319754 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409b19f-f6d0-4ba1-a299-67af8c9b96c9 None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:59:05.320043 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409b19f-f6d0-4ba1-a299-67af8c9b96c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:59:05.320321 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409b19f-f6d0-4ba1-a299-67af8c9b96c9 None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:59:05.320996 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409b19f-f6d0-4ba1-a299-67af8c9b96c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:59:05.322370 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409b19f-f6d0-4ba1-a299-67af8c9b96c9 None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:59:05.328851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 460/922] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Jul 11 11:59:05 2022] GET /identity/v3/services => generated 1962 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 11:59:07.540669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a96936-ea5a-4618-be70-bd5e8b755f47 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:59:07.541252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a96936-ea5a-4618-be70-bd5e8b755f47 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:59:07.541252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a96936-ea5a-4618-be70-bd5e8b755f47 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:59:07.542586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 463/923] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 11:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 11:59:07.547729 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1e759-972b-450f-a068-211cc6c4794f None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:59:07.548142 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1e759-972b-450f-a068-211cc6c4794f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:59:07.548302 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1e759-972b-450f-a068-211cc6c4794f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:59:07.565266 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d9c1e759-972b-450f-a068-211cc6c4794f None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 11:59:07.566451 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d9c1e759-972b-450f-a068-211cc6c4794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 11:59:07.634660 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 461/924] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 11:59:07 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 11:59:07.659299 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a96936-ea5a-4618-be70-bd5e8b755f47 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:59:07.749891 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:07.760765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a96936-ea5a-4618-be70-bd5e8b755f47 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:59:07.795402 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56303cd-2340-42b8-9e8c-9ad539f26264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:59:07.796120 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56303cd-2340-42b8-9e8c-9ad539f26264 None admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:59:07.796403 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56303cd-2340-42b8-9e8c-9ad539f26264 None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:59:07.796677 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56303cd-2340-42b8-9e8c-9ad539f26264 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:59:07.797318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56303cd-2340-42b8-9e8c-9ad539f26264 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:59:07.798678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56303cd-2340-42b8-9e8c-9ad539f26264 None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application [None req-b56303cd-2340-42b8-9e8c-9ad539f26264 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 11:59:07.811096 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 11:59:07.812210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 11:59:07.812210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 11:59:07.812210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 11:59:07.812210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 11:59:07.812210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 11:59:07.812210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 11:59:07.812210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 11:59:07.812210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 11:59:07.812210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 11:59:07.812210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 11:59:07.812210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 11:59:07.812210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 11:59:07.812210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 11:59:07.812210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 11:59:07.812210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 11:59:07.812210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 11:59:07.813384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 11:59:07.813384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application with Lock( Jul 11 11:59:07.813384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 11:59:07.813384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self._enter() Jul 11 11:59:07.813384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 11:59:07.813384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 11:59:07.813384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 11:59:07.813384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application return self.creator() Jul 11 11:59:07.813384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 11:59:07.813384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application created_value = creator( Jul 11 11:59:07.813384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 11:59:07.813384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 11:59:07.813384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 11:59:07.813384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: ERROR keystone.server.flask.application Jul 11 11:59:07.813384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 464/925] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Jul 11 11:59:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 11:59:07.819409 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1e759-972b-450f-a068-211cc6c4794f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:59:07.897086 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:07.920402 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1e759-972b-450f-a068-211cc6c4794f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:59:07.954022 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ef442-0da0-4469-a746-97599b672f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:59:07.954666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ef442-0da0-4469-a746-97599b672f6f None admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:59:07.954981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ef442-0da0-4469-a746-97599b672f6f None admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:59:07.955260 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ef442-0da0-4469-a746-97599b672f6f None admin] PATH_INFO: `/v3/services` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:59:07.955952 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ef442-0da0-4469-a746-97599b672f6f None admin] RBAC: Adding query filter params (name=placement) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 11:59:07.956258 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ef442-0da0-4469-a746-97599b672f6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:59:07.957630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ef442-0da0-4469-a746-97599b672f6f None admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:59:07.963691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 462/926] 10.222.0.25 () {56 vars in 1116 bytes} [Mon Jul 11 11:59:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 11:59:07.969393 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56303cd-2340-42b8-9e8c-9ad539f26264 None admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 11:59:08.066120 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56303cd-2340-42b8-9e8c-9ad539f26264 None admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 11:59:08.099642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b408561-ebc9-4434-a716-03b45f27569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 11:59:08.100291 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408561-ebc9-4434-a716-03b45f27569c None admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 11:59:08.100568 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408561-ebc9-4434-a716-03b45f27569c None admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 11:59:08.101090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408561-ebc9-4434-a716-03b45f27569c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 11:59:08.101816 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b408561-ebc9-4434-a716-03b45f27569c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 11:59:08.103192 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b408561-ebc9-4434-a716-03b45f27569c None admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 11:59:08.120554 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 465/927] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Jul 11 11:59:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 11:59:17.960757 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=30 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 11:59:18.116371 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:00:06.652214 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203c93d-8a4f-4945-8861-79c7df1993e7 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:06.652214 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203c93d-8a4f-4945-8861-79c7df1993e7 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:06.653771 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203c93d-8a4f-4945-8861-79c7df1993e7 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:06.653771 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 463/928] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:06.659584 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9f89f-10c8-4ad7-a3cd-f12c06db038b None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:06.660025 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9f89f-10c8-4ad7-a3cd-f12c06db038b None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:06.660207 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9f89f-10c8-4ad7-a3cd-f12c06db038b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:06.682532 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-0ff9f89f-10c8-4ad7-a3cd-f12c06db038b None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:06.682532 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-0ff9f89f-10c8-4ad7-a3cd-f12c06db038b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:06.803597 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 466/929] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:00:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:06.857207 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f49a5-50d9-46eb-9047-bd7c75ae3f52 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:06.857510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f49a5-50d9-46eb-9047-bd7c75ae3f52 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:06.857796 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f49a5-50d9-46eb-9047-bd7c75ae3f52 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:06.859211 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 464/930] 10.222.0.25 () {54 vars in 964 bytes} [Mon Jul 11 12:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:06.865763 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107d630-43e7-499c-82f8-ecb982dcc826 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:06.866056 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107d630-43e7-499c-82f8-ecb982dcc826 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:06.866334 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107d630-43e7-499c-82f8-ecb982dcc826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:06.957895 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-2107d630-43e7-499c-82f8-ecb982dcc826 None None] MFA Rules not processed for user `2b005858b98e4e27b2536d9ea3908f09`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:06.959047 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-2107d630-43e7-499c-82f8-ecb982dcc826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:07.067589 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 467/931] 10.222.0.25 () {58 vars in 1061 bytes} [Mon Jul 11 12:00:06 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:07.076218 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f49a5-50d9-46eb-9047-bd7c75ae3f52 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:00:07.087879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f49a5-50d9-46eb-9047-bd7c75ae3f52 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:00:07.095433 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa3537-fd97-4655-8d11-5379d874d93a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:00:07.095433 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa3537-fd97-4655-8d11-5379d874d93a service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:07.095433 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa3537-fd97-4655-8d11-5379d874d93a service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:07.095433 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa3537-fd97-4655-8d11-5379d874d93a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:07.105388 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa3537-fd97-4655-8d11-5379d874d93a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:00:07.107012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa3537-fd97-4655-8d11-5379d874d93a service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:00:07.118681 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 465/932] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:00:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:00:09.684343 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fd25b-697c-4cf5-bf8d-78954957ffe4 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:09.684864 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fd25b-697c-4cf5-bf8d-78954957ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:09.684864 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fd25b-697c-4cf5-bf8d-78954957ffe4 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:09.686857 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 468/933] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:09.691574 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0df2ff-52de-482f-9d08-232f3207833e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:09.693165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0df2ff-52de-482f-9d08-232f3207833e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:09.693165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0df2ff-52de-482f-9d08-232f3207833e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:09.716269 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-4f0df2ff-52de-482f-9d08-232f3207833e None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:09.717456 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4f0df2ff-52de-482f-9d08-232f3207833e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:09.726759 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 466/934] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:00:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:09.782312 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993163a-a206-460f-b1ed-46a19ed0faa5 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:09.782655 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993163a-a206-460f-b1ed-46a19ed0faa5 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:09.782922 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993163a-a206-460f-b1ed-46a19ed0faa5 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:09.784308 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 469/935] 10.222.0.25 () {54 vars in 964 bytes} [Mon Jul 11 12:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:09.791653 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49121bdc-f9b9-4a47-87c5-32a4da5d5973 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:09.792046 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49121bdc-f9b9-4a47-87c5-32a4da5d5973 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:09.792394 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49121bdc-f9b9-4a47-87c5-32a4da5d5973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:09.811364 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-49121bdc-f9b9-4a47-87c5-32a4da5d5973 None None] MFA Rules not processed for user `2b005858b98e4e27b2536d9ea3908f09`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:09.812624 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-49121bdc-f9b9-4a47-87c5-32a4da5d5973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:09.820740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 467/936] 10.222.0.25 () {58 vars in 1061 bytes} [Mon Jul 11 12:00:09 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:09.829687 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993163a-a206-460f-b1ed-46a19ed0faa5 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:00:09.841339 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993163a-a206-460f-b1ed-46a19ed0faa5 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:00:09.844886 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b689baf-8a73-45a6-9841-b58395c24a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:00:09.845560 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b689baf-8a73-45a6-9841-b58395c24a34 service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:09.845848 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b689baf-8a73-45a6-9841-b58395c24a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:09.846137 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b689baf-8a73-45a6-9841-b58395c24a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:09.857167 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b689baf-8a73-45a6-9841-b58395c24a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:00:09.858620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b689baf-8a73-45a6-9841-b58395c24a34 service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:00:09.869665 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 470/937] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:00:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:00:12.738739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b851356-8fe6-4187-b5fc-68399dbf23fb None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:12.739844 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b851356-8fe6-4187-b5fc-68399dbf23fb None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:12.739844 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b851356-8fe6-4187-b5fc-68399dbf23fb None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:12.741206 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 468/938] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:00:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:12.746281 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542c089-b242-4777-a51f-d627be2303ac None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:12.746705 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542c089-b242-4777-a51f-d627be2303ac None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:12.746909 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542c089-b242-4777-a51f-d627be2303ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:12.783206 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-2542c089-b242-4777-a51f-d627be2303ac None None] MFA Rules not processed for user `ae590453bcf24b44a05cef758b0a5f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:12.784404 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-2542c089-b242-4777-a51f-d627be2303ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:12.824983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:00:12.854287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 471/939] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:00:12 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:12.894538 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b851356-8fe6-4187-b5fc-68399dbf23fb None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:00:12.905541 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b851356-8fe6-4187-b5fc-68399dbf23fb None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:00:12.909072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33ce8f-4526-495d-9259-c09ff22af98d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:00:12.909703 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33ce8f-4526-495d-9259-c09ff22af98d service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:12.909988 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33ce8f-4526-495d-9259-c09ff22af98d service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:12.910264 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33ce8f-4526-495d-9259-c09ff22af98d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:12.920697 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33ce8f-4526-495d-9259-c09ff22af98d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:00:12.922140 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33ce8f-4526-495d-9259-c09ff22af98d service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:00:12.932691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 469/940] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:00:12 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:00:15.729569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0937872-688e-4e80-be02-b4987d3a71b8 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:15.730102 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0937872-688e-4e80-be02-b4987d3a71b8 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:15.730217 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0937872-688e-4e80-be02-b4987d3a71b8 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:15.731587 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 472/941] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:15.736838 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174afa4f-1ace-4b68-9c89-b9d9573b1803 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:15.737237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174afa4f-1ace-4b68-9c89-b9d9573b1803 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:15.737386 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174afa4f-1ace-4b68-9c89-b9d9573b1803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:15.756351 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-174afa4f-1ace-4b68-9c89-b9d9573b1803 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:15.757520 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-174afa4f-1ace-4b68-9c89-b9d9573b1803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:15.823333 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 470/942] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:00:15 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:15.865947 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0937872-688e-4e80-be02-b4987d3a71b8 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:00:15.876430 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0937872-688e-4e80-be02-b4987d3a71b8 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:00:15.880938 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3cc64-eaa1-4d4a-9351-547c9f69eb89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:00:15.881573 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3cc64-eaa1-4d4a-9351-547c9f69eb89 service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:15.881857 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3cc64-eaa1-4d4a-9351-547c9f69eb89 service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:15.882133 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3cc64-eaa1-4d4a-9351-547c9f69eb89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:15.890968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3cc64-eaa1-4d4a-9351-547c9f69eb89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:00:15.892434 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3cc64-eaa1-4d4a-9351-547c9f69eb89 service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:00:15.902945 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 473/943] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:00:15 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:00:18.807488 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fc21-c2e6-4ea7-92b7-72ba3004107f None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:18.808107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fc21-c2e6-4ea7-92b7-72ba3004107f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:18.808107 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883fc21-c2e6-4ea7-92b7-72ba3004107f None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:18.809410 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 471/944] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:18.814729 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580c53-468c-4bc3-b9d0-ac3adb336314 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:18.815179 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580c53-468c-4bc3-b9d0-ac3adb336314 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:18.815313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580c53-468c-4bc3-b9d0-ac3adb336314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:18.835109 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-ec580c53-468c-4bc3-b9d0-ac3adb336314 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:18.836312 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-ec580c53-468c-4bc3-b9d0-ac3adb336314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:18.844209 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 474/945] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:00:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:18.881311 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883fc21-c2e6-4ea7-92b7-72ba3004107f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:00:18.891774 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883fc21-c2e6-4ea7-92b7-72ba3004107f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:00:18.895429 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99033c-4443-4f0b-b6f6-1e4cc6ca216e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:00:18.896061 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99033c-4443-4f0b-b6f6-1e4cc6ca216e service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:18.896345 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99033c-4443-4f0b-b6f6-1e4cc6ca216e service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:18.896621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99033c-4443-4f0b-b6f6-1e4cc6ca216e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:18.905416 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99033c-4443-4f0b-b6f6-1e4cc6ca216e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:00:18.906891 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99033c-4443-4f0b-b6f6-1e4cc6ca216e service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:00:18.916954 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 472/946] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:00:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 12:00:21.275955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446a64d-724f-455d-832c-ea9acf51ca40 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:21.276482 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446a64d-724f-455d-832c-ea9acf51ca40 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:21.276583 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446a64d-724f-455d-832c-ea9acf51ca40 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:21.277900 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 475/947] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:21.283127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d989ba-87b1-40ea-b125-dc9a14648649 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:21.283552 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d989ba-87b1-40ea-b125-dc9a14648649 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:21.283753 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d989ba-87b1-40ea-b125-dc9a14648649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:21.302188 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-35d989ba-87b1-40ea-b125-dc9a14648649 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:21.303396 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-35d989ba-87b1-40ea-b125-dc9a14648649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:21.311093 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 473/948] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:00:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:21.347609 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446a64d-724f-455d-832c-ea9acf51ca40 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:00:21.358582 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446a64d-724f-455d-832c-ea9acf51ca40 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:00:21.361968 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c23c6e-679c-42b2-a9df-07309a953a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:00:21.362596 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c23c6e-679c-42b2-a9df-07309a953a14 service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:21.362909 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c23c6e-679c-42b2-a9df-07309a953a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:21.363189 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c23c6e-679c-42b2-a9df-07309a953a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:21.373487 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c23c6e-679c-42b2-a9df-07309a953a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:00:21.374970 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c23c6e-679c-42b2-a9df-07309a953a14 service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:00:21.385497 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 476/949] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:00:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:00:23.669791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d0776-dd3c-49df-ae67-1321230c04a3 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:23.670320 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d0776-dd3c-49df-ae67-1321230c04a3 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:23.670465 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d0776-dd3c-49df-ae67-1321230c04a3 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:23.671995 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 474/950] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:23.677966 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0921a88-c5e3-4116-8e3d-a89a49d2ead8 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:23.678353 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0921a88-c5e3-4116-8e3d-a89a49d2ead8 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:23.678637 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0921a88-c5e3-4116-8e3d-a89a49d2ead8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:23.697012 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-b0921a88-c5e3-4116-8e3d-a89a49d2ead8 None None] MFA Rules not processed for user `ae590453bcf24b44a05cef758b0a5f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:23.698194 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-b0921a88-c5e3-4116-8e3d-a89a49d2ead8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:23.706092 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 477/951] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:00:23 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:23.744347 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d0776-dd3c-49df-ae67-1321230c04a3 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:00:23.755859 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d0776-dd3c-49df-ae67-1321230c04a3 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:00:23.759290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266af64-60f4-402d-a397-3b6f08defad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:00:23.759921 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266af64-60f4-402d-a397-3b6f08defad1 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:23.760199 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266af64-60f4-402d-a397-3b6f08defad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:23.760470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266af64-60f4-402d-a397-3b6f08defad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:23.769192 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266af64-60f4-402d-a397-3b6f08defad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:00:23.771089 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266af64-60f4-402d-a397-3b6f08defad1 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:00:23.781399 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 475/952] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:00:23 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:00:26.277011 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61549fb5-2e48-461a-b7f2-c343d1d902d2 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:26.277550 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61549fb5-2e48-461a-b7f2-c343d1d902d2 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:26.277660 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61549fb5-2e48-461a-b7f2-c343d1d902d2 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:26.279019 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 478/953] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:26.284687 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6db13e-b5ee-44a4-8c05-899c66ece646 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:26.285201 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6db13e-b5ee-44a4-8c05-899c66ece646 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:26.285290 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6db13e-b5ee-44a4-8c05-899c66ece646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:26.303999 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-fc6db13e-b5ee-44a4-8c05-899c66ece646 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:26.305225 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-fc6db13e-b5ee-44a4-8c05-899c66ece646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:26.313242 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 476/954] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:00:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:26.351570 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61549fb5-2e48-461a-b7f2-c343d1d902d2 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:00:26.362227 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61549fb5-2e48-461a-b7f2-c343d1d902d2 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:00:26.365785 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2260fa-0832-4c0b-b427-37ba49c3e60a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:00:26.366355 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2260fa-0832-4c0b-b427-37ba49c3e60a service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:26.366636 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2260fa-0832-4c0b-b427-37ba49c3e60a service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:26.366940 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2260fa-0832-4c0b-b427-37ba49c3e60a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:26.376105 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2260fa-0832-4c0b-b427-37ba49c3e60a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:00:26.377639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2260fa-0832-4c0b-b427-37ba49c3e60a service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:00:26.388116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 479/955] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:00:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:00:28.687779 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad4dd-5069-4025-a56f-aa863ae04ec7 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:28.688300 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad4dd-5069-4025-a56f-aa863ae04ec7 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:28.688300 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ad4dd-5069-4025-a56f-aa863ae04ec7 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:28.689752 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 477/956] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:28.695574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff2999-f30e-4d23-a2ac-baca457f2b6e None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:28.695966 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff2999-f30e-4d23-a2ac-baca457f2b6e None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:28.696126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff2999-f30e-4d23-a2ac-baca457f2b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:28.714030 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-0fff2999-f30e-4d23-a2ac-baca457f2b6e None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:28.715222 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-0fff2999-f30e-4d23-a2ac-baca457f2b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:28.722901 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 480/957] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:00:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:28.766346 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ad4dd-5069-4025-a56f-aa863ae04ec7 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:00:28.772673 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=68 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:00:28.779415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ad4dd-5069-4025-a56f-aa863ae04ec7 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:00:28.782990 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39914269-7813-4245-ab55-5597194799c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:00:28.783630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39914269-7813-4245-ab55-5597194799c6 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:28.783914 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39914269-7813-4245-ab55-5597194799c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:28.784193 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39914269-7813-4245-ab55-5597194799c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:28.793927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39914269-7813-4245-ab55-5597194799c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:00:28.795409 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39914269-7813-4245-ab55-5597194799c6 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:00:28.806067 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 478/958] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:00:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:00:31.346695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e9f54-2e89-411c-bdbf-d8f60d1bb150 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:31.347237 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e9f54-2e89-411c-bdbf-d8f60d1bb150 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:31.347355 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e9f54-2e89-411c-bdbf-d8f60d1bb150 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:31.349357 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 481/959] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:31.354851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef7940-0582-45e0-b4a1-309107f03cc5 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:31.355277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef7940-0582-45e0-b4a1-309107f03cc5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:31.355412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef7940-0582-45e0-b4a1-309107f03cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:31.373609 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-f6ef7940-0582-45e0-b4a1-309107f03cc5 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:31.374873 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f6ef7940-0582-45e0-b4a1-309107f03cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:31.382600 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 479/960] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:00:31 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:31.418818 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e9f54-2e89-411c-bdbf-d8f60d1bb150 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:00:31.432597 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e9f54-2e89-411c-bdbf-d8f60d1bb150 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:00:31.436735 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee49e0-eae2-4b79-9345-aca08e425ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:00:31.437379 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee49e0-eae2-4b79-9345-aca08e425ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:31.437672 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee49e0-eae2-4b79-9345-aca08e425ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:31.437947 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee49e0-eae2-4b79-9345-aca08e425ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:31.447271 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee49e0-eae2-4b79-9345-aca08e425ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:00:31.448717 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee49e0-eae2-4b79-9345-aca08e425ee0 service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:00:31.458017 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 482/961] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:00:31 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:00:35.978539 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81b7b7-77b0-4bae-acfc-9af4f1d53fe5 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:35.979065 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81b7b7-77b0-4bae-acfc-9af4f1d53fe5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:35.979065 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81b7b7-77b0-4bae-acfc-9af4f1d53fe5 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:35.980425 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 480/962] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:35.985525 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223301a5-777a-4b07-997d-433fb8d18646 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:35.985935 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223301a5-777a-4b07-997d-433fb8d18646 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:35.986216 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223301a5-777a-4b07-997d-433fb8d18646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:36.003697 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-223301a5-777a-4b07-997d-433fb8d18646 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:36.005430 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-223301a5-777a-4b07-997d-433fb8d18646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:36.013186 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 483/963] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:00:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:36.052833 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81b7b7-77b0-4bae-acfc-9af4f1d53fe5 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:00:36.063392 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81b7b7-77b0-4bae-acfc-9af4f1d53fe5 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:00:36.066884 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519c27c-b0dc-4d9a-b188-79f0a5bc027e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:00:36.068084 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519c27c-b0dc-4d9a-b188-79f0a5bc027e service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:36.068415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519c27c-b0dc-4d9a-b188-79f0a5bc027e service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:36.068688 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519c27c-b0dc-4d9a-b188-79f0a5bc027e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:36.077450 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519c27c-b0dc-4d9a-b188-79f0a5bc027e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:00:36.078916 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519c27c-b0dc-4d9a-b188-79f0a5bc027e service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:00:36.088867 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 481/964] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:00:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:00:38.955840 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792d963-dc8d-450c-b1c1-fbc07dc68ee6 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:38.956358 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792d963-dc8d-450c-b1c1-fbc07dc68ee6 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:38.956358 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792d963-dc8d-450c-b1c1-fbc07dc68ee6 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:38.957773 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 484/965] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:38.963224 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb479ea-750a-47c6-aa1e-411c29a19920 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:38.963660 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb479ea-750a-47c6-aa1e-411c29a19920 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:38.963915 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb479ea-750a-47c6-aa1e-411c29a19920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:38.984812 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-ddb479ea-750a-47c6-aa1e-411c29a19920 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:38.986011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ddb479ea-750a-47c6-aa1e-411c29a19920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:38.995495 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 482/966] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:00:38 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:00:39.037006 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792d963-dc8d-450c-b1c1-fbc07dc68ee6 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:00:39.050353 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792d963-dc8d-450c-b1c1-fbc07dc68ee6 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:00:39.054517 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc6922-5396-4f51-9ed6-865e6e1a6efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:00:39.055182 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc6922-5396-4f51-9ed6-865e6e1a6efd service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:39.055464 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc6922-5396-4f51-9ed6-865e6e1a6efd service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:39.055734 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc6922-5396-4f51-9ed6-865e6e1a6efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:39.064863 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc6922-5396-4f51-9ed6-865e6e1a6efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:00:39.066285 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc6922-5396-4f51-9ed6-865e6e1a6efd service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:00:39.075608 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 485/967] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:00:39 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:00:43.663554 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b70032-95bd-489e-9a41-ca900907d68d None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:43.664049 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b70032-95bd-489e-9a41-ca900907d68d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:43.664168 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b70032-95bd-489e-9a41-ca900907d68d None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:43.665458 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 483/968] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:43.670692 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13468521-6cb2-44b9-b0ff-ebee5d8cb153 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:43.671180 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13468521-6cb2-44b9-b0ff-ebee5d8cb153 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:43.671313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13468521-6cb2-44b9-b0ff-ebee5d8cb153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:43.677773 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=54 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:00:43.690356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-13468521-6cb2-44b9-b0ff-ebee5d8cb153 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:43.691574 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-13468521-6cb2-44b9-b0ff-ebee5d8cb153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:43.699923 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 486/969] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:00:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:43.741126 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b70032-95bd-489e-9a41-ca900907d68d None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:00:43.752076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b70032-95bd-489e-9a41-ca900907d68d None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:00:43.756370 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b93a8-589d-4931-81bd-f40df2b1f174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:00:43.757044 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b93a8-589d-4931-81bd-f40df2b1f174 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:43.757326 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b93a8-589d-4931-81bd-f40df2b1f174 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:43.757601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b93a8-589d-4931-81bd-f40df2b1f174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:43.766597 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b93a8-589d-4931-81bd-f40df2b1f174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:00:43.768065 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b93a8-589d-4931-81bd-f40df2b1f174 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:00:43.778151 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 484/970] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:00:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 12:00:49.365162 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efbafb-5616-4426-bde9-a8b62266cb30 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:49.365717 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efbafb-5616-4426-bde9-a8b62266cb30 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:49.365993 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efbafb-5616-4426-bde9-a8b62266cb30 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:49.367826 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 487/971] 10.222.0.25 () {54 vars in 921 bytes} [Mon Jul 11 12:00:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:49.372955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6173c-c51e-4ec0-b0b6-ebc7a358db5c None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:49.373390 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6173c-c51e-4ec0-b0b6-ebc7a358db5c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:49.373721 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6173c-c51e-4ec0-b0b6-ebc7a358db5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:49.417947 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-6ec6173c-c51e-4ec0-b0b6-ebc7a358db5c None None] MFA Rules not processed for user `fc6d2bcfca0a495582d322494b054045`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:49.419588 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6ec6173c-c51e-4ec0-b0b6-ebc7a358db5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:49.504375 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 485/972] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Jul 11 12:00:49 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:53.685269 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=2 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:00:53.863766 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b477e6-5f14-49d3-8f28-1d875ca8a182 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:53.864798 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b477e6-5f14-49d3-8f28-1d875ca8a182 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:53.865203 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b477e6-5f14-49d3-8f28-1d875ca8a182 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:53.866816 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 488/973] 10.222.0.25 () {54 vars in 921 bytes} [Mon Jul 11 12:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:53.872144 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd8901-a20a-48da-b9ee-8d8822838492 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:53.872603 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd8901-a20a-48da-b9ee-8d8822838492 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:53.872701 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd8901-a20a-48da-b9ee-8d8822838492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:53.893214 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-defd8901-a20a-48da-b9ee-8d8822838492 None None] MFA Rules not processed for user `fc6d2bcfca0a495582d322494b054045`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:53.894521 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-defd8901-a20a-48da-b9ee-8d8822838492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:53.904438 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 486/974] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Jul 11 12:00:53 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:55.439333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272cd16-a5dc-447e-b2f7-dc84d52750f7 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:55.439851 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272cd16-a5dc-447e-b2f7-dc84d52750f7 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:55.439851 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272cd16-a5dc-447e-b2f7-dc84d52750f7 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:55.441202 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 489/975] 10.222.0.25 () {54 vars in 921 bytes} [Mon Jul 11 12:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:55.446370 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efad11-0665-4c26-8a25-136f35d9e93e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:55.446805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efad11-0665-4c26-8a25-136f35d9e93e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:55.447103 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efad11-0665-4c26-8a25-136f35d9e93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:55.465346 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-80efad11-0665-4c26-8a25-136f35d9e93e None None] MFA Rules not processed for user `fc6d2bcfca0a495582d322494b054045`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:55.466533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-80efad11-0665-4c26-8a25-136f35d9e93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:55.475682 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 487/976] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Jul 11 12:00:55 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:59.523776 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4d5b8-59ac-4a08-ac2e-c8f9a47b4098 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:59.524326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4d5b8-59ac-4a08-ac2e-c8f9a47b4098 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:59.524326 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4d5b8-59ac-4a08-ac2e-c8f9a47b4098 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:59.525685 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 490/977] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:59.530885 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cf8f7-5a58-468e-9212-9013a365c71d None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:59.531315 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cf8f7-5a58-468e-9212-9013a365c71d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:59.531706 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cf8f7-5a58-468e-9212-9013a365c71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:59.539555 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=69 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:00:59.554918 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c51cf8f7-5a58-468e-9212-9013a365c71d None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:59.556646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c51cf8f7-5a58-468e-9212-9013a365c71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:59.565014 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 488/978] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:00:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:59.632334 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfd941-a984-4166-8c58-50646beddfc1 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:59.632989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfd941-a984-4166-8c58-50646beddfc1 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:59.633355 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfd941-a984-4166-8c58-50646beddfc1 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:59.636943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 491/979] 10.222.0.25 () {54 vars in 961 bytes} [Mon Jul 11 12:00:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:00:59.653110 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f2772-fc3c-4cc3-8dbe-73333480f955 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:59.657218 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f2772-fc3c-4cc3-8dbe-73333480f955 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:59.657769 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f2772-fc3c-4cc3-8dbe-73333480f955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:59.696164 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-ca5f2772-fc3c-4cc3-8dbe-73333480f955 None None] MFA Rules not processed for user `11550a0ca11041b0b9b175860f2b6633`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:00:59.697613 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ca5f2772-fc3c-4cc3-8dbe-73333480f955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:00:59.782563 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 489/980] 10.222.0.25 () {58 vars in 1058 bytes} [Mon Jul 11 12:00:59 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:00:59.790546 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfd941-a984-4166-8c58-50646beddfc1 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:00:59.805104 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfd941-a984-4166-8c58-50646beddfc1 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:00:59.810156 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1037213-82bd-4a3a-9f9b-0d27b67343b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:00:59.810821 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1037213-82bd-4a3a-9f9b-0d27b67343b8 service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:00:59.811111 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1037213-82bd-4a3a-9f9b-0d27b67343b8 service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:00:59.811388 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1037213-82bd-4a3a-9f9b-0d27b67343b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:00:59.820394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1037213-82bd-4a3a-9f9b-0d27b67343b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:00:59.821996 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1037213-82bd-4a3a-9f9b-0d27b67343b8 service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:00:59.831931 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 492/981] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:00:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 12:01:02.311408 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30e3e2-16e7-4b79-aac7-15c3f9b7765e None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:02.311927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30e3e2-16e7-4b79-aac7-15c3f9b7765e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:02.311927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30e3e2-16e7-4b79-aac7-15c3f9b7765e None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:02.313387 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 490/982] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:02.319196 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1efa84-7dd3-4163-ae23-ac1236ba4c5e None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:02.319613 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1efa84-7dd3-4163-ae23-ac1236ba4c5e None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:02.319752 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1efa84-7dd3-4163-ae23-ac1236ba4c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:02.338470 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-6d1efa84-7dd3-4163-ae23-ac1236ba4c5e None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:02.339678 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-6d1efa84-7dd3-4163-ae23-ac1236ba4c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:02.347668 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 493/983] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:01:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:02.392751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30e3e2-16e7-4b79-aac7-15c3f9b7765e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:02.406978 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30e3e2-16e7-4b79-aac7-15c3f9b7765e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:02.412855 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07abde-4084-4537-800e-39ca26549fa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:02.413685 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07abde-4084-4537-800e-39ca26549fa7 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:02.414138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07abde-4084-4537-800e-39ca26549fa7 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:02.414564 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07abde-4084-4537-800e-39ca26549fa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:02.423829 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07abde-4084-4537-800e-39ca26549fa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:02.425580 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07abde-4084-4537-800e-39ca26549fa7 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:02.436809 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 491/984] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:05.065975 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca0b39-953d-41d4-b318-174706dd997f None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:05.066841 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca0b39-953d-41d4-b318-174706dd997f None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:05.067300 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca0b39-953d-41d4-b318-174706dd997f None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:05.069562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 494/985] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:01:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:05.075320 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d95ce-3229-4b5e-821b-4a4139dcb853 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:05.075800 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d95ce-3229-4b5e-821b-4a4139dcb853 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:05.076358 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d95ce-3229-4b5e-821b-4a4139dcb853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:05.124010 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-053d95ce-3229-4b5e-821b-4a4139dcb853 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:05.125477 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-053d95ce-3229-4b5e-821b-4a4139dcb853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:05.135345 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 492/986] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:01:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:05.182042 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280a708-afd6-4724-9830-85a5bbd6fbed None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:05.182401 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280a708-afd6-4724-9830-85a5bbd6fbed None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:05.182790 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280a708-afd6-4724-9830-85a5bbd6fbed None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:05.184292 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 495/987] 10.222.0.25 () {54 vars in 961 bytes} [Mon Jul 11 12:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:05.189742 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a747d0d-71ee-4262-aacc-24897e3aae76 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:05.190045 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a747d0d-71ee-4262-aacc-24897e3aae76 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:05.190306 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a747d0d-71ee-4262-aacc-24897e3aae76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:05.209829 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-1a747d0d-71ee-4262-aacc-24897e3aae76 None None] MFA Rules not processed for user `11550a0ca11041b0b9b175860f2b6633`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:05.211213 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-1a747d0d-71ee-4262-aacc-24897e3aae76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:05.219574 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 493/988] 10.222.0.25 () {58 vars in 1058 bytes} [Mon Jul 11 12:01:05 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:01:05.228428 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280a708-afd6-4724-9830-85a5bbd6fbed None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:05.242789 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280a708-afd6-4724-9830-85a5bbd6fbed None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:05.247681 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8faae-0908-4126-b02a-f042710b0546 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:05.248320 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8faae-0908-4126-b02a-f042710b0546 service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:05.248604 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8faae-0908-4126-b02a-f042710b0546 service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:05.248880 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8faae-0908-4126-b02a-f042710b0546 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:05.257650 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8faae-0908-4126-b02a-f042710b0546 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:05.259298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8faae-0908-4126-b02a-f042710b0546 service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:05.268766 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 496/989] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:07.643080 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046a4ab-6879-49c3-85ba-57d08c38012b None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:07.643955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046a4ab-6879-49c3-85ba-57d08c38012b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:07.644418 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046a4ab-6879-49c3-85ba-57d08c38012b None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:07.646417 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 494/990] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:01:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:07.652372 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b85b6-44a9-453e-a2fe-b06bd466c67e None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:07.652860 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b85b6-44a9-453e-a2fe-b06bd466c67e None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:07.652943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b85b6-44a9-453e-a2fe-b06bd466c67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:07.674161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-9f2b85b6-44a9-453e-a2fe-b06bd466c67e None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:07.675852 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-9f2b85b6-44a9-453e-a2fe-b06bd466c67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:07.695298 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 497/991] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:01:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:07.739291 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046a4ab-6879-49c3-85ba-57d08c38012b None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:07.759128 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046a4ab-6879-49c3-85ba-57d08c38012b None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:07.764611 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078962c5-abe5-46b9-9a1f-dcc044436188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:07.765507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078962c5-abe5-46b9-9a1f-dcc044436188 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:07.766005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078962c5-abe5-46b9-9a1f-dcc044436188 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:07.766513 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078962c5-abe5-46b9-9a1f-dcc044436188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:07.776693 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078962c5-abe5-46b9-9a1f-dcc044436188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:07.778696 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078962c5-abe5-46b9-9a1f-dcc044436188 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:07.789546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 495/992] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:09.732305 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc13c16-f062-4a28-8c9e-40d3380ee1e0 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:09.732752 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc13c16-f062-4a28-8c9e-40d3380ee1e0 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:09.732893 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc13c16-f062-4a28-8c9e-40d3380ee1e0 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:09.741238 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec8b37-4001-41e7-8691-c444cff09ed4 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:09.741680 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec8b37-4001-41e7-8691-c444cff09ed4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:09.742077 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec8b37-4001-41e7-8691-c444cff09ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:09.744041 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 498/993] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:01:09 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:09.771247 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7dec8b37-4001-41e7-8691-c444cff09ed4 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:09.772579 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7dec8b37-4001-41e7-8691-c444cff09ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:09.782284 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 496/994] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:01:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:10.096508 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da033c63-a7c6-4c52-a3a2-fff225b72bff None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:10.096861 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da033c63-a7c6-4c52-a3a2-fff225b72bff None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:10.097140 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da033c63-a7c6-4c52-a3a2-fff225b72bff None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:10.099007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 499/995] 10.222.0.25 () {54 vars in 963 bytes} [Mon Jul 11 12:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:10.104791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9c5c7-12dc-4080-96a8-209fe7a2945a None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:10.105106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9c5c7-12dc-4080-96a8-209fe7a2945a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:10.105340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9c5c7-12dc-4080-96a8-209fe7a2945a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:10.147452 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c8d9c5c7-12dc-4080-96a8-209fe7a2945a None None] MFA Rules not processed for user `009ac389925143f1954c5d1971155318`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:10.148692 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c8d9c5c7-12dc-4080-96a8-209fe7a2945a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:10.219372 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 497/996] 10.222.0.25 () {58 vars in 1060 bytes} [Mon Jul 11 12:01:10 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:10.227804 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da033c63-a7c6-4c52-a3a2-fff225b72bff None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:10.238567 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da033c63-a7c6-4c52-a3a2-fff225b72bff None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:10.243403 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8586d6b-5321-4694-8c49-1e5ec49428fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009ac389925143f1954c5d1971155318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:10.244131 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8586d6b-5321-4694-8c49-1e5ec49428fe service cinder] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:10.244484 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8586d6b-5321-4694-8c49-1e5ec49428fe service cinder] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:10.244827 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8586d6b-5321-4694-8c49-1e5ec49428fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:10.254356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8586d6b-5321-4694-8c49-1e5ec49428fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:10.256626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8586d6b-5321-4694-8c49-1e5ec49428fe service cinder] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:10.260696 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f761f-a569-4ceb-a45d-98bd0bf614c8 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:10.261166 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f761f-a569-4ceb-a45d-98bd0bf614c8 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:10.261454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f761f-a569-4ceb-a45d-98bd0bf614c8 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:10.262854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 498/997] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:10.267723 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 500/998] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:10.268987 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07eb337-024b-4475-bb10-d4f648269bb3 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:10.269278 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07eb337-024b-4475-bb10-d4f648269bb3 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:10.269739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07eb337-024b-4475-bb10-d4f648269bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:10.292329 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-e07eb337-024b-4475-bb10-d4f648269bb3 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:10.293563 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-e07eb337-024b-4475-bb10-d4f648269bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:10.302287 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 499/999] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:01:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:01:10.349427 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8586d6b-5321-4694-8c49-1e5ec49428fe service cinder] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:10.361361 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8586d6b-5321-4694-8c49-1e5ec49428fe service cinder] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:10.367647 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0ff58-caca-41d3-852f-9ca13bc7df3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:10.368290 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0ff58-caca-41d3-852f-9ca13bc7df3e service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:10.368572 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0ff58-caca-41d3-852f-9ca13bc7df3e service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:10.368844 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0ff58-caca-41d3-852f-9ca13bc7df3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:10.377535 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0ff58-caca-41d3-852f-9ca13bc7df3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:10.379164 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0ff58-caca-41d3-852f-9ca13bc7df3e service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:10.389213 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 501/1000] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:12.700667 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1b518-a720-4e5f-857d-14c2300ca7ab None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:12.701174 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1b518-a720-4e5f-857d-14c2300ca7ab None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:12.701293 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1b518-a720-4e5f-857d-14c2300ca7ab None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:12.702632 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 500/1001] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:12.708217 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d4b4f-7099-4d5f-aa6f-183a55f00cc9 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:12.708670 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d4b4f-7099-4d5f-aa6f-183a55f00cc9 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:12.708765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d4b4f-7099-4d5f-aa6f-183a55f00cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:12.726926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-9a1d4b4f-7099-4d5f-aa6f-183a55f00cc9 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:12.728380 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-9a1d4b4f-7099-4d5f-aa6f-183a55f00cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:12.736258 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 502/1002] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:01:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:12.781184 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1b518-a720-4e5f-857d-14c2300ca7ab None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:12.791407 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:01:12.796536 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1b518-a720-4e5f-857d-14c2300ca7ab None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:12.801829 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf288e7-d22a-45b9-b1ec-df0cdcabd7fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:12.802596 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf288e7-d22a-45b9-b1ec-df0cdcabd7fb service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:12.802784 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf288e7-d22a-45b9-b1ec-df0cdcabd7fb service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:12.803470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf288e7-d22a-45b9-b1ec-df0cdcabd7fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:12.811880 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf288e7-d22a-45b9-b1ec-df0cdcabd7fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:12.813476 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf288e7-d22a-45b9-b1ec-df0cdcabd7fb service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:12.824856 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 501/1003] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:15.145783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f0498-09d8-43b8-9dee-d36ad2f098c4 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:15.146410 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f0498-09d8-43b8-9dee-d36ad2f098c4 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:15.146410 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f0498-09d8-43b8-9dee-d36ad2f098c4 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:15.147698 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 503/1004] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 12:01:15.152926 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16f58b-a16f-4b5b-8bf7-edb405413987 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:15.153346 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16f58b-a16f-4b5b-8bf7-edb405413987 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:15.153482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16f58b-a16f-4b5b-8bf7-edb405413987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:15.182956 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-9d16f58b-a16f-4b5b-8bf7-edb405413987 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:15.184238 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-9d16f58b-a16f-4b5b-8bf7-edb405413987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:15.192474 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 502/1005] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:01:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:15.235921 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f0498-09d8-43b8-9dee-d36ad2f098c4 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:15.250089 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f0498-09d8-43b8-9dee-d36ad2f098c4 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:15.255335 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd7252-2454-49bf-8a10-a2fa72d844e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:15.256213 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd7252-2454-49bf-8a10-a2fa72d844e4 service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:15.256717 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd7252-2454-49bf-8a10-a2fa72d844e4 service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:15.257215 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd7252-2454-49bf-8a10-a2fa72d844e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:15.265904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd7252-2454-49bf-8a10-a2fa72d844e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:15.267744 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd7252-2454-49bf-8a10-a2fa72d844e4 service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:15.278865 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 504/1006] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:17.530800 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9366504-6e1b-43b8-901c-26e08eca5b34 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:17.531339 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9366504-6e1b-43b8-901c-26e08eca5b34 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:17.531339 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9366504-6e1b-43b8-901c-26e08eca5b34 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:17.534279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 503/1007] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:01:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:17.537904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55214e-a825-48aa-9196-1fc1d28640d2 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:17.538695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55214e-a825-48aa-9196-1fc1d28640d2 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:17.539031 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55214e-a825-48aa-9196-1fc1d28640d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:17.557462 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-7e55214e-a825-48aa-9196-1fc1d28640d2 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:17.558663 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-7e55214e-a825-48aa-9196-1fc1d28640d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:17.566750 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 505/1008] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:01:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:17.613289 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9366504-6e1b-43b8-901c-26e08eca5b34 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:17.627492 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9366504-6e1b-43b8-901c-26e08eca5b34 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:17.633322 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619e4b7-d272-4cab-9f7c-d2499dabca40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:17.634084 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619e4b7-d272-4cab-9f7c-d2499dabca40 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:17.634470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619e4b7-d272-4cab-9f7c-d2499dabca40 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:17.634883 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619e4b7-d272-4cab-9f7c-d2499dabca40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:17.643387 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619e4b7-d272-4cab-9f7c-d2499dabca40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:17.645060 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619e4b7-d272-4cab-9f7c-d2499dabca40 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:17.654884 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 504/1009] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:20.405647 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8918b-dc6d-43b4-94e7-d845f54dc890 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:20.406228 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8918b-dc6d-43b4-94e7-d845f54dc890 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:20.406228 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8918b-dc6d-43b4-94e7-d845f54dc890 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:20.407545 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 506/1010] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:20.413014 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d0e2-dbc3-4631-8660-70c90894298d None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:20.413508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d0e2-dbc3-4631-8660-70c90894298d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:20.413611 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d0e2-dbc3-4631-8660-70c90894298d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:20.431526 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-90f9d0e2-dbc3-4631-8660-70c90894298d None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:20.432722 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-90f9d0e2-dbc3-4631-8660-70c90894298d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:20.440488 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 505/1011] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:01:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:20.487688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8918b-dc6d-43b4-94e7-d845f54dc890 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:20.501937 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8918b-dc6d-43b4-94e7-d845f54dc890 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:20.507808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bcc01-bffa-4ab4-803f-672d1a454edf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:20.508475 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bcc01-bffa-4ab4-803f-672d1a454edf service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:20.508771 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bcc01-bffa-4ab4-803f-672d1a454edf service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:20.509058 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bcc01-bffa-4ab4-803f-672d1a454edf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:20.518353 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bcc01-bffa-4ab4-803f-672d1a454edf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:20.520037 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bcc01-bffa-4ab4-803f-672d1a454edf service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:20.530511 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 507/1012] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 12:01:23.122064 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff6497-95d8-4b17-bded-2828926bcfdf None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:23.123125 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff6497-95d8-4b17-bded-2828926bcfdf None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:23.123449 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff6497-95d8-4b17-bded-2828926bcfdf None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:23.124892 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 506/1013] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:23.131162 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f95632-9010-4281-a766-8422829b5a64 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:23.131664 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f95632-9010-4281-a766-8422829b5a64 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:23.131774 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f95632-9010-4281-a766-8422829b5a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:23.150380 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-41f95632-9010-4281-a766-8422829b5a64 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:23.151622 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-41f95632-9010-4281-a766-8422829b5a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:23.161041 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 508/1014] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:01:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:23.218392 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff6497-95d8-4b17-bded-2828926bcfdf None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:23.232706 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff6497-95d8-4b17-bded-2828926bcfdf None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:23.238172 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd28a4f-240e-44b6-a7df-1c8c86afa641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:23.238890 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28a4f-240e-44b6-a7df-1c8c86afa641 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:23.239276 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28a4f-240e-44b6-a7df-1c8c86afa641 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:23.240111 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28a4f-240e-44b6-a7df-1c8c86afa641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:23.249573 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd28a4f-240e-44b6-a7df-1c8c86afa641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:23.251279 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd28a4f-240e-44b6-a7df-1c8c86afa641 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:23.262349 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 507/1015] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:26.139549 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53a614-56d5-4295-8c14-e83909026849 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:26.141101 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53a614-56d5-4295-8c14-e83909026849 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:26.141101 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53a614-56d5-4295-8c14-e83909026849 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:26.141769 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 509/1016] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:26.144094 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91ffce-8905-48bc-9480-72f180e80288 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:26.144599 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91ffce-8905-48bc-9480-72f180e80288 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:26.144703 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91ffce-8905-48bc-9480-72f180e80288 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:26.146502 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 508/1017] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:26.147465 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f04df-9d45-47ea-a59e-ed58baae29f7 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:26.147763 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f04df-9d45-47ea-a59e-ed58baae29f7 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:26.148044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f04df-9d45-47ea-a59e-ed58baae29f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:26.153031 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57f4aa-e1c2-4930-aa95-ac7acb6c8ac1 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:26.153321 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57f4aa-e1c2-4930-aa95-ac7acb6c8ac1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:26.153591 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57f4aa-e1c2-4930-aa95-ac7acb6c8ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:26.155631 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=52 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:01:26.169374 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-057f04df-9d45-47ea-a59e-ed58baae29f7 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:26.170573 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-057f04df-9d45-47ea-a59e-ed58baae29f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:26.180764 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-6b57f4aa-e1c2-4930-aa95-ac7acb6c8ac1 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:26.181943 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 510/1018] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:01:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:01:26.182078 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-6b57f4aa-e1c2-4930-aa95-ac7acb6c8ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:26.189809 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 509/1019] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:01:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:01:26.227108 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f04df-9d45-47ea-a59e-ed58baae29f7 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:26.238979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f04df-9d45-47ea-a59e-ed58baae29f7 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:26.244584 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0350099-9189-44e0-80b6-9e58f6aa581e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:26.245221 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0350099-9189-44e0-80b6-9e58f6aa581e service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:26.245507 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0350099-9189-44e0-80b6-9e58f6aa581e service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:26.245806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0350099-9189-44e0-80b6-9e58f6aa581e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:26.246910 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80360f00-03f2-43fb-a35f-e341dca306bc None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:26.247205 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80360f00-03f2-43fb-a35f-e341dca306bc None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:26.247485 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80360f00-03f2-43fb-a35f-e341dca306bc None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:26.248847 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 510/1020] 10.222.0.25 () {54 vars in 962 bytes} [Mon Jul 11 12:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 12:01:26.253713 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d00653-ccbd-4dc9-aca4-fdfef53cebc0 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:26.253999 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d00653-ccbd-4dc9-aca4-fdfef53cebc0 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:26.254276 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d00653-ccbd-4dc9-aca4-fdfef53cebc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:26.254394 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0350099-9189-44e0-80b6-9e58f6aa581e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:26.255936 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0350099-9189-44e0-80b6-9e58f6aa581e service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:26.265447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 511/1021] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:26.292594 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-19d00653-ccbd-4dc9-aca4-fdfef53cebc0 None None] MFA Rules not processed for user `dce9ec24be9049bfacddcf3c068f2f65`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:26.293822 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-19d00653-ccbd-4dc9-aca4-fdfef53cebc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:26.359962 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 511/1022] 10.222.0.25 () {58 vars in 1059 bytes} [Mon Jul 11 12:01:26 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:01:26.368789 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0350099-9189-44e0-80b6-9e58f6aa581e service nova] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:26.378238 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0350099-9189-44e0-80b6-9e58f6aa581e service nova] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:26.381952 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a26340-28f1-401c-aef1-d320825a4d22 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce9ec24be9049bfacddcf3c068f2f65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:26.382742 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a26340-28f1-401c-aef1-d320825a4d22 service glance] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:26.383093 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a26340-28f1-401c-aef1-d320825a4d22 service glance] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:26.383435 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a26340-28f1-401c-aef1-d320825a4d22 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:26.393543 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a26340-28f1-401c-aef1-d320825a4d22 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:26.395093 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a26340-28f1-401c-aef1-d320825a4d22 service glance] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:26.405695 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 512/1023] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:28.587163 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5b4ce-f4c4-451b-88fb-683ee9b1136f None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:28.587805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5b4ce-f4c4-451b-88fb-683ee9b1136f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:28.587805 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5b4ce-f4c4-451b-88fb-683ee9b1136f None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:28.589094 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 512/1024] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:28.594520 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec2cf-e52c-41f2-a7d0-ae150b3d0164 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:28.595109 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec2cf-e52c-41f2-a7d0-ae150b3d0164 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:28.595109 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec2cf-e52c-41f2-a7d0-ae150b3d0164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:28.613861 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-371ec2cf-e52c-41f2-a7d0-ae150b3d0164 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:28.615844 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-371ec2cf-e52c-41f2-a7d0-ae150b3d0164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:28.625337 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 513/1025] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:01:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:28.671852 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5b4ce-f4c4-451b-88fb-683ee9b1136f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:28.685623 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5b4ce-f4c4-451b-88fb-683ee9b1136f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:28.692077 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03f1d1-78a1-4437-ae37-183a41b313fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:28.693390 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03f1d1-78a1-4437-ae37-183a41b313fe service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:28.693673 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03f1d1-78a1-4437-ae37-183a41b313fe service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:28.693944 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03f1d1-78a1-4437-ae37-183a41b313fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:28.702910 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03f1d1-78a1-4437-ae37-183a41b313fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:28.705878 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03f1d1-78a1-4437-ae37-183a41b313fe service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:28.716614 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 513/1026] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:38.609374 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=17 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:01:38.711853 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=64 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:01:41.982473 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856e251-217d-486d-95c4-1590317a9f20 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:41.983142 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856e251-217d-486d-95c4-1590317a9f20 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:41.983142 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856e251-217d-486d-95c4-1590317a9f20 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:41.984440 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 514/1027] 10.222.0.25 () {54 vars in 918 bytes} [Mon Jul 11 12:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:41.990103 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd46c8-2104-441a-a473-29e189502944 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:41.990581 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd46c8-2104-441a-a473-29e189502944 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:41.990693 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd46c8-2104-441a-a473-29e189502944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:42.008714 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-f4fd46c8-2104-441a-a473-29e189502944 None None] MFA Rules not processed for user `fc6d2bcfca0a495582d322494b054045`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:42.009869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f4fd46c8-2104-441a-a473-29e189502944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:42.018127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 514/1028] 10.222.0.25 () {58 vars in 1015 bytes} [Mon Jul 11 12:01:41 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:01:42.032137 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114857e1-8e0a-4004-8e1f-a95e60425976 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:42.032431 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114857e1-8e0a-4004-8e1f-a95e60425976 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:42.032713 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114857e1-8e0a-4004-8e1f-a95e60425976 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:42.034079 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 515/1029] 10.222.0.25 () {54 vars in 918 bytes} [Mon Jul 11 12:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:42.039357 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666cbb9-8d41-4ae2-999a-68d111d84fad None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:42.039646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666cbb9-8d41-4ae2-999a-68d111d84fad None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:42.039925 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666cbb9-8d41-4ae2-999a-68d111d84fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:42.058506 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7666cbb9-8d41-4ae2-999a-68d111d84fad None None] MFA Rules not processed for user `11550a0ca11041b0b9b175860f2b6633`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:42.059711 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7666cbb9-8d41-4ae2-999a-68d111d84fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:42.068115 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 515/1030] 10.222.0.25 () {58 vars in 1015 bytes} [Mon Jul 11 12:01:42 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:44.925938 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26ffb8-df41-4802-9e04-660bf5a767d4 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:44.926502 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26ffb8-df41-4802-9e04-660bf5a767d4 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:44.926502 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26ffb8-df41-4802-9e04-660bf5a767d4 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:44.929745 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 516/1031] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 12:01:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:44.935228 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99377e-1c38-4d72-8b6a-053dd6e5204c None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:44.935702 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99377e-1c38-4d72-8b6a-053dd6e5204c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:44.935810 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99377e-1c38-4d72-8b6a-053dd6e5204c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:44.954550 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-da99377e-1c38-4d72-8b6a-053dd6e5204c None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:44.955768 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-da99377e-1c38-4d72-8b6a-053dd6e5204c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:44.963954 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 516/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 12:01:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:45.008407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26ffb8-df41-4802-9e04-660bf5a767d4 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:45.022342 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26ffb8-df41-4802-9e04-660bf5a767d4 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:45.027268 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194bf06-e421-418b-be73-181646709da5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:45.027894 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194bf06-e421-418b-be73-181646709da5 service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:45.028177 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194bf06-e421-418b-be73-181646709da5 service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:45.028447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194bf06-e421-418b-be73-181646709da5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:45.037153 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194bf06-e421-418b-be73-181646709da5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:45.038738 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194bf06-e421-418b-be73-181646709da5 service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:45.048013 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 517/1033] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:46.008751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc149d-af1c-4477-b460-e294cc12bd51 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:46.009319 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc149d-af1c-4477-b460-e294cc12bd51 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:46.009319 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc149d-af1c-4477-b460-e294cc12bd51 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:46.010662 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 517/1034] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 12:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:46.015455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41196488-b8e4-44e4-908c-e7a061642eaf None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:46.015846 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41196488-b8e4-44e4-908c-e7a061642eaf None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:46.016031 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41196488-b8e4-44e4-908c-e7a061642eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:46.034248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-41196488-b8e4-44e4-908c-e7a061642eaf None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:46.035451 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-41196488-b8e4-44e4-908c-e7a061642eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:46.043851 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 518/1035] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 12:01:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:46.281171 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc149d-af1c-4477-b460-e294cc12bd51 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:46.294388 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc149d-af1c-4477-b460-e294cc12bd51 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:46.299344 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4c850-e199-4433-8259-f7673c3697e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:46.299971 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4c850-e199-4433-8259-f7673c3697e3 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:46.300254 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4c850-e199-4433-8259-f7673c3697e3 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:46.300527 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4c850-e199-4433-8259-f7673c3697e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:46.309126 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4c850-e199-4433-8259-f7673c3697e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:46.310730 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4c850-e199-4433-8259-f7673c3697e3 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:46.320744 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 518/1036] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:47.232715 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91d766-2b7d-4c79-9ce3-7128051bae94 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:47.233230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91d766-2b7d-4c79-9ce3-7128051bae94 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:47.233350 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91d766-2b7d-4c79-9ce3-7128051bae94 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:47.234623 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 519/1037] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 12:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:47.240178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17df9a7-0638-4782-b14b-5e3dc6974858 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:47.240606 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17df9a7-0638-4782-b14b-5e3dc6974858 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:47.240848 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17df9a7-0638-4782-b14b-5e3dc6974858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:47.259533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-d17df9a7-0638-4782-b14b-5e3dc6974858 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:47.260726 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d17df9a7-0638-4782-b14b-5e3dc6974858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:47.268501 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 519/1038] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 12:01:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:01:47.439220 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91d766-2b7d-4c79-9ce3-7128051bae94 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:47.453126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91d766-2b7d-4c79-9ce3-7128051bae94 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:47.459242 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ced242-3e18-4c1e-81cb-456c3fc9f7e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:47.459880 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ced242-3e18-4c1e-81cb-456c3fc9f7e2 service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:47.460167 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ced242-3e18-4c1e-81cb-456c3fc9f7e2 service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:47.460444 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ced242-3e18-4c1e-81cb-456c3fc9f7e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:47.468635 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ced242-3e18-4c1e-81cb-456c3fc9f7e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:47.470222 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ced242-3e18-4c1e-81cb-456c3fc9f7e2 service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:47.480600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 520/1039] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:48.354699 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9854c-47cc-4b59-b8c7-d5569db80c35 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:48.355307 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9854c-47cc-4b59-b8c7-d5569db80c35 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:48.355404 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9854c-47cc-4b59-b8c7-d5569db80c35 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:48.356703 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 520/1040] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 12:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:48.361541 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0eac4-877a-48aa-95d7-ab7f69887043 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:48.361932 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0eac4-877a-48aa-95d7-ab7f69887043 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:48.362101 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0eac4-877a-48aa-95d7-ab7f69887043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:48.380975 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-1ce0eac4-877a-48aa-95d7-ab7f69887043 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:48.382168 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-1ce0eac4-877a-48aa-95d7-ab7f69887043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:48.390044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 521/1041] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 12:01:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:48.544896 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9854c-47cc-4b59-b8c7-d5569db80c35 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:48.559317 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9854c-47cc-4b59-b8c7-d5569db80c35 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:48.564220 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c3b50-ca89-4468-a358-27f2bbc1c19d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:48.564852 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c3b50-ca89-4468-a358-27f2bbc1c19d service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:48.565138 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c3b50-ca89-4468-a358-27f2bbc1c19d service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:48.565415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c3b50-ca89-4468-a358-27f2bbc1c19d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:48.574269 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c3b50-ca89-4468-a358-27f2bbc1c19d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:48.575898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c3b50-ca89-4468-a358-27f2bbc1c19d service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:48.585813 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 521/1042] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:49.456458 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49699699-0b04-44ea-96a4-fbc0719d43d0 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:49.456993 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49699699-0b04-44ea-96a4-fbc0719d43d0 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:49.456993 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49699699-0b04-44ea-96a4-fbc0719d43d0 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:49.458379 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 522/1043] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 12:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:49.463208 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af691066-fef9-427b-8e3e-4d621851ca60 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:49.463633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af691066-fef9-427b-8e3e-4d621851ca60 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:49.463842 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af691066-fef9-427b-8e3e-4d621851ca60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:49.482451 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-af691066-fef9-427b-8e3e-4d621851ca60 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:49.483680 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-af691066-fef9-427b-8e3e-4d621851ca60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:49.492094 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 522/1044] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 12:01:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:49.646958 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49699699-0b04-44ea-96a4-fbc0719d43d0 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:49.661882 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49699699-0b04-44ea-96a4-fbc0719d43d0 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:49.667389 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2e704-1ce6-4dd8-a71a-92965158f9c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:49.668130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2e704-1ce6-4dd8-a71a-92965158f9c4 service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:49.668510 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2e704-1ce6-4dd8-a71a-92965158f9c4 service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:49.668882 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2e704-1ce6-4dd8-a71a-92965158f9c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:49.677741 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2e704-1ce6-4dd8-a71a-92965158f9c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:49.679358 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2e704-1ce6-4dd8-a71a-92965158f9c4 service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:49.688613 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 523/1045] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:50.496307 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea28e4-a905-4857-8a53-2845869f0a6e None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:50.496834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea28e4-a905-4857-8a53-2845869f0a6e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:50.496948 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea28e4-a905-4857-8a53-2845869f0a6e None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:50.498222 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 523/1046] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 12:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:50.503026 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0faddf-92e8-4394-b934-99fa0b115bd2 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:50.503471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0faddf-92e8-4394-b934-99fa0b115bd2 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:50.503569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0faddf-92e8-4394-b934-99fa0b115bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:50.522369 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-0a0faddf-92e8-4394-b934-99fa0b115bd2 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:50.523606 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-0a0faddf-92e8-4394-b934-99fa0b115bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:50.531490 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 524/1047] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 12:01:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:50.686726 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea28e4-a905-4857-8a53-2845869f0a6e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:50.700173 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea28e4-a905-4857-8a53-2845869f0a6e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:50.705028 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb0e26-008c-43bf-b125-5f05d4553e6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:50.705654 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb0e26-008c-43bf-b125-5f05d4553e6e service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:50.705933 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb0e26-008c-43bf-b125-5f05d4553e6e service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:50.706206 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb0e26-008c-43bf-b125-5f05d4553e6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:50.714640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb0e26-008c-43bf-b125-5f05d4553e6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:50.716238 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb0e26-008c-43bf-b125-5f05d4553e6e service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:50.726161 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 524/1048] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:51.533104 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98471-85bb-427f-a194-15049889a6e9 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:51.533627 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98471-85bb-427f-a194-15049889a6e9 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:51.533743 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98471-85bb-427f-a194-15049889a6e9 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:51.535054 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 525/1049] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 12:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:51.540418 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5614495-e294-4096-aa44-da6ecf193a12 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:51.540844 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5614495-e294-4096-aa44-da6ecf193a12 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:51.540955 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5614495-e294-4096-aa44-da6ecf193a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:51.558578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c5614495-e294-4096-aa44-da6ecf193a12 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:51.559780 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c5614495-e294-4096-aa44-da6ecf193a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:51.567492 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 525/1050] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 12:01:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:51.721606 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d98471-85bb-427f-a194-15049889a6e9 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:51.735864 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d98471-85bb-427f-a194-15049889a6e9 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:51.741722 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9aa2e-3f39-424c-866b-7f2d611cef63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:51.742380 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9aa2e-3f39-424c-866b-7f2d611cef63 service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:51.742667 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9aa2e-3f39-424c-866b-7f2d611cef63 service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:51.742974 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9aa2e-3f39-424c-866b-7f2d611cef63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:51.751450 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9aa2e-3f39-424c-866b-7f2d611cef63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:51.753081 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9aa2e-3f39-424c-866b-7f2d611cef63 service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:51.762959 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 526/1051] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:52.580598 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c42c76-a9d3-448a-9218-6232ceef4760 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:52.581137 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c42c76-a9d3-448a-9218-6232ceef4760 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:52.581137 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c42c76-a9d3-448a-9218-6232ceef4760 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:52.582520 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 526/1052] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 12:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:52.587976 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924a759-6d89-4d40-8c40-370898d8ad59 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:52.588399 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924a759-6d89-4d40-8c40-370898d8ad59 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:52.588532 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924a759-6d89-4d40-8c40-370898d8ad59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:52.606308 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-a924a759-6d89-4d40-8c40-370898d8ad59 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:52.607516 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-a924a759-6d89-4d40-8c40-370898d8ad59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:52.615236 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 527/1053] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 12:01:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:01:52.772165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c42c76-a9d3-448a-9218-6232ceef4760 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:52.785406 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c42c76-a9d3-448a-9218-6232ceef4760 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:52.790513 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292e87f-d11f-4c83-b3f9-9acfcaa1af63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:52.791201 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292e87f-d11f-4c83-b3f9-9acfcaa1af63 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:52.791482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292e87f-d11f-4c83-b3f9-9acfcaa1af63 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:52.791756 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292e87f-d11f-4c83-b3f9-9acfcaa1af63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:52.799662 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292e87f-d11f-4c83-b3f9-9acfcaa1af63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:52.801229 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292e87f-d11f-4c83-b3f9-9acfcaa1af63 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:52.811200 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 527/1054] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:53.622947 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be609da-0660-46c0-90c5-a208cca60161 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:53.623512 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be609da-0660-46c0-90c5-a208cca60161 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:53.623512 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be609da-0660-46c0-90c5-a208cca60161 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:53.624861 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 528/1055] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 12:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:53.629743 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307b2d8-3746-4487-9439-5a4f1bf379f7 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:53.630282 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307b2d8-3746-4487-9439-5a4f1bf379f7 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:53.630282 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307b2d8-3746-4487-9439-5a4f1bf379f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:53.648447 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7307b2d8-3746-4487-9439-5a4f1bf379f7 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:53.649623 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7307b2d8-3746-4487-9439-5a4f1bf379f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:53.657579 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 528/1056] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 12:01:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:53.811391 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be609da-0660-46c0-90c5-a208cca60161 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:53.824562 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be609da-0660-46c0-90c5-a208cca60161 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:53.829651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0cbdd-9cec-4852-949d-382172fefba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:53.830301 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0cbdd-9cec-4852-949d-382172fefba0 service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:53.830592 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0cbdd-9cec-4852-949d-382172fefba0 service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:53.830922 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0cbdd-9cec-4852-949d-382172fefba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:53.840143 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0cbdd-9cec-4852-949d-382172fefba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:53.841731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0cbdd-9cec-4852-949d-382172fefba0 service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:53.852207 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 529/1057] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:55.957314 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9738f93-1a48-4887-a7f1-cf81e4d453a1 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:55.958452 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9738f93-1a48-4887-a7f1-cf81e4d453a1 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:55.958682 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9738f93-1a48-4887-a7f1-cf81e4d453a1 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:55.959915 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 529/1058] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 12:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:55.965038 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c458337-2d27-47da-ae4c-33c7a09916d6 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:55.965486 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c458337-2d27-47da-ae4c-33c7a09916d6 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:55.965582 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c458337-2d27-47da-ae4c-33c7a09916d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:55.983965 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-1c458337-2d27-47da-ae4c-33c7a09916d6 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:55.985147 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-1c458337-2d27-47da-ae4c-33c7a09916d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:55.993129 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 530/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 12:01:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:56.032191 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9738f93-1a48-4887-a7f1-cf81e4d453a1 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:56.043225 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9738f93-1a48-4887-a7f1-cf81e4d453a1 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:56.046625 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c125e6-1b62-4e55-98cc-22a40cbd64c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:56.047278 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c125e6-1b62-4e55-98cc-22a40cbd64c4 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:56.047556 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c125e6-1b62-4e55-98cc-22a40cbd64c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:56.047825 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c125e6-1b62-4e55-98cc-22a40cbd64c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:56.056823 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c125e6-1b62-4e55-98cc-22a40cbd64c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:56.058250 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c125e6-1b62-4e55-98cc-22a40cbd64c4 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:56.067492 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 530/1060] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:01:58.453145 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d7476-972f-4129-ad28-00e48770def3 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:58.453666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d7476-972f-4129-ad28-00e48770def3 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:58.453666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d7476-972f-4129-ad28-00e48770def3 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:58.455062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 531/1061] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 12:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:01:58.460308 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a0206-0b90-412e-8c39-3e5bd9a1e5dc None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:58.460752 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a0206-0b90-412e-8c39-3e5bd9a1e5dc None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:58.460845 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a0206-0b90-412e-8c39-3e5bd9a1e5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:58.479302 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c41a0206-0b90-412e-8c39-3e5bd9a1e5dc None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:01:58.480491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c41a0206-0b90-412e-8c39-3e5bd9a1e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:01:58.488244 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 531/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 12:01:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:01:58.526978 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d7476-972f-4129-ad28-00e48770def3 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:01:58.538131 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d7476-972f-4129-ad28-00e48770def3 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:01:58.541628 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa850a3f-04c9-441d-b673-96f699a9c1e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:01:58.542261 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa850a3f-04c9-441d-b673-96f699a9c1e5 service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:01:58.542546 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa850a3f-04c9-441d-b673-96f699a9c1e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:01:58.542856 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa850a3f-04c9-441d-b673-96f699a9c1e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:01:58.552209 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa850a3f-04c9-441d-b673-96f699a9c1e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:01:58.553646 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa850a3f-04c9-441d-b673-96f699a9c1e5 service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:01:58.562864 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 532/1063] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:01:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:02:01.144101 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a5d95-85c7-47f9-9352-8b9383a94f1d None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:01.144665 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a5d95-85c7-47f9-9352-8b9383a94f1d None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:01.144665 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a5d95-85c7-47f9-9352-8b9383a94f1d None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:01.146898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 532/1064] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 12:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:02:01.152586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd1e05-1759-4ad8-ae9a-76a33fa154fa None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:01.153045 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd1e05-1759-4ad8-ae9a-76a33fa154fa None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:01.153133 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd1e05-1759-4ad8-ae9a-76a33fa154fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:01.172041 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-d7fd1e05-1759-4ad8-ae9a-76a33fa154fa None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:02:01.173268 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-d7fd1e05-1759-4ad8-ae9a-76a33fa154fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:02:01.182214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 533/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 12:02:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:02:01.221589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a5d95-85c7-47f9-9352-8b9383a94f1d None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:02:01.232830 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a5d95-85c7-47f9-9352-8b9383a94f1d None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:02:01.236323 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c2131-4f33-4cd1-ade8-6abd80b19c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:02:01.236960 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c2131-4f33-4cd1-ade8-6abd80b19c38 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:01.237238 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c2131-4f33-4cd1-ade8-6abd80b19c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:01.237510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c2131-4f33-4cd1-ade8-6abd80b19c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:01.247142 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c2131-4f33-4cd1-ade8-6abd80b19c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:02:01.248580 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c2131-4f33-4cd1-ade8-6abd80b19c38 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:02:01.258625 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 533/1066] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:02:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:02:03.622958 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d0cdd-4a6c-4efc-a43b-91f8caedd681 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:03.623384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d0cdd-4a6c-4efc-a43b-91f8caedd681 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:03.623517 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d0cdd-4a6c-4efc-a43b-91f8caedd681 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:03.624905 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 534/1067] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 12:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:02:03.630053 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f25fc0-093b-4cb3-b3d5-0ed48c8e2474 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:03.630676 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f25fc0-093b-4cb3-b3d5-0ed48c8e2474 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:03.630676 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f25fc0-093b-4cb3-b3d5-0ed48c8e2474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:03.647916 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-13f25fc0-093b-4cb3-b3d5-0ed48c8e2474 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:02:03.649089 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-13f25fc0-093b-4cb3-b3d5-0ed48c8e2474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:02:03.657057 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 534/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 12:02:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:02:03.697048 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d0cdd-4a6c-4efc-a43b-91f8caedd681 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:02:03.707498 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d0cdd-4a6c-4efc-a43b-91f8caedd681 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:02:03.711219 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a06255-87a1-41b3-9a04-a42d8eb78124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:02:03.711847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a06255-87a1-41b3-9a04-a42d8eb78124 service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:03.712129 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a06255-87a1-41b3-9a04-a42d8eb78124 service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:03.712397 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a06255-87a1-41b3-9a04-a42d8eb78124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:03.720972 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a06255-87a1-41b3-9a04-a42d8eb78124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:02:03.722434 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a06255-87a1-41b3-9a04-a42d8eb78124 service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:02:03.732792 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 535/1069] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:02:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:02:06.041056 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520e998-9b03-43c8-ac50-4121f45b4c2f None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:06.041596 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520e998-9b03-43c8-ac50-4121f45b4c2f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:06.041596 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520e998-9b03-43c8-ac50-4121f45b4c2f None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:06.043015 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 535/1070] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 12:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:02:06.048342 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8db8-2782-4f0f-90dd-ee515c2397fa None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:06.048750 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8db8-2782-4f0f-90dd-ee515c2397fa None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:06.048886 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8db8-2782-4f0f-90dd-ee515c2397fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:06.067991 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-400a8db8-2782-4f0f-90dd-ee515c2397fa None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:02:06.069167 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-400a8db8-2782-4f0f-90dd-ee515c2397fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:02:06.076871 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 536/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 12:02:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:02:06.116129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520e998-9b03-43c8-ac50-4121f45b4c2f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:02:06.126589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520e998-9b03-43c8-ac50-4121f45b4c2f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:02:06.130060 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9f92c-17bc-458b-9dcb-246fe6058648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:02:06.130675 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9f92c-17bc-458b-9dcb-246fe6058648 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:06.130984 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9f92c-17bc-458b-9dcb-246fe6058648 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:06.131254 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9f92c-17bc-458b-9dcb-246fe6058648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:06.139818 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9f92c-17bc-458b-9dcb-246fe6058648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:02:06.141238 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9f92c-17bc-458b-9dcb-246fe6058648 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:02:06.150503 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 536/1072] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:02:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:02:08.460150 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e901e7-6ebd-49d5-82d8-fa37579161b6 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:08.460683 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e901e7-6ebd-49d5-82d8-fa37579161b6 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:08.460683 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e901e7-6ebd-49d5-82d8-fa37579161b6 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:08.461987 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 537/1073] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 12:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:02:08.467323 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4184988-2bb1-4b07-a5e0-e0423115aa4a None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:08.467766 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4184988-2bb1-4b07-a5e0-e0423115aa4a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:08.467886 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4184988-2bb1-4b07-a5e0-e0423115aa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:08.487141 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-f4184988-2bb1-4b07-a5e0-e0423115aa4a None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:02:08.488335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f4184988-2bb1-4b07-a5e0-e0423115aa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:02:08.496268 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 537/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 12:02:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:02:08.534703 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e901e7-6ebd-49d5-82d8-fa37579161b6 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:02:08.545848 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e901e7-6ebd-49d5-82d8-fa37579161b6 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:02:08.549275 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdac412-3777-4b39-bbf5-4487c67c15ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:02:08.549899 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdac412-3777-4b39-bbf5-4487c67c15ab service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:08.550174 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdac412-3777-4b39-bbf5-4487c67c15ab service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:08.550441 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdac412-3777-4b39-bbf5-4487c67c15ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:08.560256 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdac412-3777-4b39-bbf5-4487c67c15ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:02:08.561675 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdac412-3777-4b39-bbf5-4487c67c15ab service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:02:08.571630 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 538/1075] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:02:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:02:10.851927 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864696fa-58e3-4965-893d-6587c8c64868 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:10.852493 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864696fa-58e3-4965-893d-6587c8c64868 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:10.852493 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864696fa-58e3-4965-893d-6587c8c64868 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:10.854129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 538/1076] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 12:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:02:10.859280 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e364e2-da07-4f0a-b49a-b914fa2c39ff None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:10.859672 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e364e2-da07-4f0a-b49a-b914fa2c39ff None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:10.859836 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e364e2-da07-4f0a-b49a-b914fa2c39ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:10.866508 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=70 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:02:10.879137 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-25e364e2-da07-4f0a-b49a-b914fa2c39ff None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:02:10.880396 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-25e364e2-da07-4f0a-b49a-b914fa2c39ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:02:10.888153 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 539/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 12:02:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:02:10.927697 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864696fa-58e3-4965-893d-6587c8c64868 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:02:10.933116 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=73 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:02:10.939264 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864696fa-58e3-4965-893d-6587c8c64868 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:02:10.942810 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29010514-999e-4d8b-955e-6a694b7b620e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:02:10.943442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010514-999e-4d8b-955e-6a694b7b620e service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:10.943718 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010514-999e-4d8b-955e-6a694b7b620e service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:10.943992 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29010514-999e-4d8b-955e-6a694b7b620e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:10.953035 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29010514-999e-4d8b-955e-6a694b7b620e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:02:10.954493 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29010514-999e-4d8b-955e-6a694b7b620e service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:02:10.965215 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 539/1078] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:02:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:02:13.238699 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30d86-5c70-4692-968e-444f63f12b83 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:13.239760 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30d86-5c70-4692-968e-444f63f12b83 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:13.239868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30d86-5c70-4692-968e-444f63f12b83 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:13.241306 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 540/1079] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 12:02:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:02:13.246468 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68242c1-bb15-40d3-8f01-411e9cfba0d6 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:13.247019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68242c1-bb15-40d3-8f01-411e9cfba0d6 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:13.247121 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68242c1-bb15-40d3-8f01-411e9cfba0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:13.265012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b68242c1-bb15-40d3-8f01-411e9cfba0d6 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:02:13.266180 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b68242c1-bb15-40d3-8f01-411e9cfba0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:02:13.273929 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 540/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 12:02:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:02:13.311158 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f30d86-5c70-4692-968e-444f63f12b83 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:02:13.322363 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f30d86-5c70-4692-968e-444f63f12b83 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:02:13.325806 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4dc2e3-09b5-434e-b2f4-49081c7ea278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:02:13.326428 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4dc2e3-09b5-434e-b2f4-49081c7ea278 service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:13.326726 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4dc2e3-09b5-434e-b2f4-49081c7ea278 service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:13.327013 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4dc2e3-09b5-434e-b2f4-49081c7ea278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:13.335886 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4dc2e3-09b5-434e-b2f4-49081c7ea278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:02:13.337303 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4dc2e3-09b5-434e-b2f4-49081c7ea278 service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:02:13.350998 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 541/1081] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:02:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:02:15.574562 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f583-483e-4298-8058-a1eafbc53b41 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:15.575174 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f583-483e-4298-8058-a1eafbc53b41 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:15.575174 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f583-483e-4298-8058-a1eafbc53b41 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:15.576502 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 541/1082] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 12:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:02:15.581669 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78595cb7-2925-4d9d-bf35-9a6259e1155d None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:15.582116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78595cb7-2925-4d9d-bf35-9a6259e1155d None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:15.582228 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78595cb7-2925-4d9d-bf35-9a6259e1155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:15.601842 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-78595cb7-2925-4d9d-bf35-9a6259e1155d None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:02:15.603082 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-78595cb7-2925-4d9d-bf35-9a6259e1155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:02:15.610962 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 542/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 12:02:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:02:15.649484 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6f583-483e-4298-8058-a1eafbc53b41 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:02:15.660221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6f583-483e-4298-8058-a1eafbc53b41 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:02:15.663924 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761e4f6-5f71-4754-bbae-a328a9e5f0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:02:15.664558 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e4f6-5f71-4754-bbae-a328a9e5f0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:15.664843 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e4f6-5f71-4754-bbae-a328a9e5f0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:15.665120 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761e4f6-5f71-4754-bbae-a328a9e5f0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:15.674284 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761e4f6-5f71-4754-bbae-a328a9e5f0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:02:15.675749 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761e4f6-5f71-4754-bbae-a328a9e5f0f1 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:02:15.685742 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 542/1084] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:02:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:02:17.951234 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c825f-a800-4872-9191-5bb7074c6c33 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:17.951772 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c825f-a800-4872-9191-5bb7074c6c33 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:17.951772 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c825f-a800-4872-9191-5bb7074c6c33 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:17.953153 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 543/1085] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 12:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:02:17.958954 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584e01e-8aa6-412d-8b41-3c70b2ceaebd None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:17.959358 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584e01e-8aa6-412d-8b41-3c70b2ceaebd None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:17.959501 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584e01e-8aa6-412d-8b41-3c70b2ceaebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:17.977434 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-f584e01e-8aa6-412d-8b41-3c70b2ceaebd None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:02:17.978611 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f584e01e-8aa6-412d-8b41-3c70b2ceaebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:02:17.986578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 543/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 12:02:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:02:18.026282 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c825f-a800-4872-9191-5bb7074c6c33 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:02:18.037182 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c825f-a800-4872-9191-5bb7074c6c33 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:02:18.040642 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc1c67-6ef4-489a-a29c-79477180773a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:02:18.041266 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc1c67-6ef4-489a-a29c-79477180773a service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:18.041549 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc1c67-6ef4-489a-a29c-79477180773a service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:18.041823 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc1c67-6ef4-489a-a29c-79477180773a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:18.050462 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc1c67-6ef4-489a-a29c-79477180773a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:02:18.052039 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc1c67-6ef4-489a-a29c-79477180773a service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:02:18.061137 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 544/1087] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:02:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:02:27.972226 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=17 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:02:28.057118 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=17 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:02:41.819005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640744d-6a5e-4370-a36f-8a6e1fdb2d9b None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:41.819576 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640744d-6a5e-4370-a36f-8a6e1fdb2d9b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:41.819576 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640744d-6a5e-4370-a36f-8a6e1fdb2d9b None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:41.820947 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 544/1088] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:02:41.826176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816658b0-87b4-48c4-8804-608c848ac739 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:41.826578 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816658b0-87b4-48c4-8804-608c848ac739 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:41.826759 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816658b0-87b4-48c4-8804-608c848ac739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:41.844594 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-816658b0-87b4-48c4-8804-608c848ac739 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:02:41.845802 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-816658b0-87b4-48c4-8804-608c848ac739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:02:41.854292 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 545/1089] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:02:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:02:41.905072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b24b6-d3a3-41a9-820c-9142f3d6ec39 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:41.905364 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b24b6-d3a3-41a9-820c-9142f3d6ec39 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:41.905645 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b24b6-d3a3-41a9-820c-9142f3d6ec39 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:41.907037 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 545/1090] 10.222.0.25 () {54 vars in 962 bytes} [Mon Jul 11 12:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:02:41.913334 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948293-1228-45b9-b67c-7233e0b74378 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:41.913620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948293-1228-45b9-b67c-7233e0b74378 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:41.913899 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948293-1228-45b9-b67c-7233e0b74378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:41.933116 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-b9948293-1228-45b9-b67c-7233e0b74378 None None] MFA Rules not processed for user `dce9ec24be9049bfacddcf3c068f2f65`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:02:41.934302 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-b9948293-1228-45b9-b67c-7233e0b74378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:02:41.940720 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 546/1091] 10.222.0.25 () {58 vars in 1059 bytes} [Mon Jul 11 12:02:41 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:02:41.948869 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b24b6-d3a3-41a9-820c-9142f3d6ec39 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:02:41.959498 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b24b6-d3a3-41a9-820c-9142f3d6ec39 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:02:41.962987 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957c227-e480-4043-a9a1-477ca5611241 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce9ec24be9049bfacddcf3c068f2f65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:02:41.963605 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957c227-e480-4043-a9a1-477ca5611241 service glance] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:41.963884 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957c227-e480-4043-a9a1-477ca5611241 service glance] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:41.964178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957c227-e480-4043-a9a1-477ca5611241 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:41.972774 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957c227-e480-4043-a9a1-477ca5611241 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:02:41.974866 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957c227-e480-4043-a9a1-477ca5611241 service glance] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:02:41.984256 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 546/1092] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:02:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:02:44.321583 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54ed07-2ac1-487d-86a1-c5ff13b1fa02 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:44.322203 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54ed07-2ac1-487d-86a1-c5ff13b1fa02 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:44.322203 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54ed07-2ac1-487d-86a1-c5ff13b1fa02 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:44.323539 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 547/1093] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:02:44.328640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38155-ad67-4d36-a564-987b41d038ba None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:44.329036 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38155-ad67-4d36-a564-987b41d038ba None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:44.329198 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f38155-ad67-4d36-a564-987b41d038ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:44.347181 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c5f38155-ad67-4d36-a564-987b41d038ba None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:02:44.348975 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c5f38155-ad67-4d36-a564-987b41d038ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:02:44.356954 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 547/1094] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:02:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:02:44.381716 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54ed07-2ac1-487d-86a1-c5ff13b1fa02 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:02:44.393979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54ed07-2ac1-487d-86a1-c5ff13b1fa02 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:02:44.398367 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8ce7a-7956-48b0-ab5f-9f78fcf0f1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:02:44.399044 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8ce7a-7956-48b0-ab5f-9f78fcf0f1af admin admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:44.399329 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8ce7a-7956-48b0-ab5f-9f78fcf0f1af admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:44.399605 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8ce7a-7956-48b0-ab5f-9f78fcf0f1af admin admin] PATH_INFO: `/v3/projects` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:44.400323 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8ce7a-7956-48b0-ab5f-9f78fcf0f1af admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:02:44.402090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: WARNING py.warnings [None req-32c8ce7a-7956-48b0-ab5f-9f78fcf0f1af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 12:02:44.402090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: warnings.warn(msg) Jul 11 12:02:44.402090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: Jul 11 12:02:44.403274 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8ce7a-7956-48b0-ab5f-9f78fcf0f1af admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:02:44.421633 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 548/1095] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Jul 11 12:02:44 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 12:02:46.810736 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55846c78-a82d-422b-bccd-e6f2a6fe97fa None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:46.811346 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55846c78-a82d-422b-bccd-e6f2a6fe97fa None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:46.811346 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55846c78-a82d-422b-bccd-e6f2a6fe97fa None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:46.812702 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 548/1096] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:02:46.817857 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc52c5-6600-4a5e-9303-a4a3c49ce0d2 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:46.818252 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc52c5-6600-4a5e-9303-a4a3c49ce0d2 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:46.818415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc52c5-6600-4a5e-9303-a4a3c49ce0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:46.836633 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-d9fc52c5-6600-4a5e-9303-a4a3c49ce0d2 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:02:46.837852 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-d9fc52c5-6600-4a5e-9303-a4a3c49ce0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:02:46.845712 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 549/1097] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:02:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:02:46.890312 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55846c78-a82d-422b-bccd-e6f2a6fe97fa None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:02:46.904401 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55846c78-a82d-422b-bccd-e6f2a6fe97fa None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:02:46.909441 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70158785-9774-4d3c-8680-cb187ee316b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:02:46.910074 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70158785-9774-4d3c-8680-cb187ee316b2 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:46.910403 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70158785-9774-4d3c-8680-cb187ee316b2 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:46.911251 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70158785-9774-4d3c-8680-cb187ee316b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:46.919983 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70158785-9774-4d3c-8680-cb187ee316b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:02:46.921566 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70158785-9774-4d3c-8680-cb187ee316b2 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:02:46.931271 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 549/1098] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:02:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:02:49.383941 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042b4d-f43d-49a6-89c4-8b1b2d37376c None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:49.384473 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042b4d-f43d-49a6-89c4-8b1b2d37376c None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:49.384591 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042b4d-f43d-49a6-89c4-8b1b2d37376c None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:49.385877 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 550/1099] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:02:49.391058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2b251-a327-4185-85fe-82137f2fee94 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:49.391512 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2b251-a327-4185-85fe-82137f2fee94 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:49.391611 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2b251-a327-4185-85fe-82137f2fee94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:49.409694 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-5ad2b251-a327-4185-85fe-82137f2fee94 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:02:49.411005 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-5ad2b251-a327-4185-85fe-82137f2fee94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:02:49.418776 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 550/1100] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:02:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:02:49.455742 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042b4d-f43d-49a6-89c4-8b1b2d37376c None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:02:49.466851 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042b4d-f43d-49a6-89c4-8b1b2d37376c None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:02:49.470287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118442e-91ec-4286-817c-a13227a604dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:02:49.470953 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118442e-91ec-4286-817c-a13227a604dd service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:49.471241 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118442e-91ec-4286-817c-a13227a604dd service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:49.471535 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118442e-91ec-4286-817c-a13227a604dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:49.480653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118442e-91ec-4286-817c-a13227a604dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:02:49.482110 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118442e-91ec-4286-817c-a13227a604dd service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:02:49.491418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 551/1101] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:02:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:02:51.765082 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2600f9a-a23e-4ccd-beba-bf212442bb8f None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:51.765606 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2600f9a-a23e-4ccd-beba-bf212442bb8f None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:51.765606 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2600f9a-a23e-4ccd-beba-bf212442bb8f None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:51.767046 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 551/1102] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:02:51.772733 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe8659-39ea-47db-b943-3d45062f29ba None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:51.773147 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe8659-39ea-47db-b943-3d45062f29ba None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:51.773287 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe8659-39ea-47db-b943-3d45062f29ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:51.790466 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-a6fe8659-39ea-47db-b943-3d45062f29ba None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:02:51.791676 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-a6fe8659-39ea-47db-b943-3d45062f29ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:02:51.799316 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 552/1103] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:02:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:02:51.837373 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2600f9a-a23e-4ccd-beba-bf212442bb8f None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:02:51.849567 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2600f9a-a23e-4ccd-beba-bf212442bb8f None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:02:51.853059 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ab48a-156a-49e1-b921-a61f2064b761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:02:51.853689 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ab48a-156a-49e1-b921-a61f2064b761 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:51.853972 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ab48a-156a-49e1-b921-a61f2064b761 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:51.854248 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ab48a-156a-49e1-b921-a61f2064b761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:51.863448 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ab48a-156a-49e1-b921-a61f2064b761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:02:51.865019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ab48a-156a-49e1-b921-a61f2064b761 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:02:51.874399 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 552/1104] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:02:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:02:54.172737 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825751d1-1027-438a-aa49-8fcc0b4d38f8 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:54.173267 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825751d1-1027-438a-aa49-8fcc0b4d38f8 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:54.173267 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825751d1-1027-438a-aa49-8fcc0b4d38f8 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:54.174809 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 553/1105] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:02:54.179917 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98254be-cf1c-452d-9ea0-b71d5789ede0 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:54.180327 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98254be-cf1c-452d-9ea0-b71d5789ede0 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:54.180508 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98254be-cf1c-452d-9ea0-b71d5789ede0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:54.199662 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-b98254be-cf1c-452d-9ea0-b71d5789ede0 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:02:54.200854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-b98254be-cf1c-452d-9ea0-b71d5789ede0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:02:54.209365 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 553/1106] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:02:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:02:54.251238 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825751d1-1027-438a-aa49-8fcc0b4d38f8 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:02:54.263005 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825751d1-1027-438a-aa49-8fcc0b4d38f8 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:02:54.266471 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afad8b-8634-4c22-95a2-5c382c159e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:02:54.267134 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afad8b-8634-4c22-95a2-5c382c159e9a service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:54.267413 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afad8b-8634-4c22-95a2-5c382c159e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:54.267682 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afad8b-8634-4c22-95a2-5c382c159e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:54.276474 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afad8b-8634-4c22-95a2-5c382c159e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:02:54.277896 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afad8b-8634-4c22-95a2-5c382c159e9a service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:02:54.287619 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 554/1107] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:02:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:02:56.774767 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34106d8-a6f6-44af-ac19-d82ac9a8e070 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:56.775334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34106d8-a6f6-44af-ac19-d82ac9a8e070 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:56.775334 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34106d8-a6f6-44af-ac19-d82ac9a8e070 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:56.776699 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 554/1108] 10.222.0.25 () {54 vars in 926 bytes} [Mon Jul 11 12:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:02:56.781756 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d74139-4293-4d81-bdf0-5e32579793c3 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:56.782143 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d74139-4293-4d81-bdf0-5e32579793c3 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:56.782318 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d74139-4293-4d81-bdf0-5e32579793c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:56.799651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-e8d74139-4293-4d81-bdf0-5e32579793c3 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:02:56.800847 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-e8d74139-4293-4d81-bdf0-5e32579793c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:02:56.810095 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 555/1109] 10.222.0.25 () {58 vars in 1023 bytes} [Mon Jul 11 12:02:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:02:56.851578 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34106d8-a6f6-44af-ac19-d82ac9a8e070 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:02:56.862280 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34106d8-a6f6-44af-ac19-d82ac9a8e070 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:02:56.866140 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aeb25c-f522-4a67-b71d-24a765d11f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:02:56.866795 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aeb25c-f522-4a67-b71d-24a765d11f73 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:02:56.867079 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aeb25c-f522-4a67-b71d-24a765d11f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:02:56.867353 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aeb25c-f522-4a67-b71d-24a765d11f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:02:56.876015 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aeb25c-f522-4a67-b71d-24a765d11f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:02:56.877442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aeb25c-f522-4a67-b71d-24a765d11f73 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:02:56.887256 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 555/1110] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:02:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:03:06.794802 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=33 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:03:06.883291 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=33 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:04:24.828953 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbba78-47d8-4697-9f9e-3e0e83e756f9 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:24.829569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbba78-47d8-4697-9f9e-3e0e83e756f9 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:24.829569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbba78-47d8-4697-9f9e-3e0e83e756f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:24.848109 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-76dbba78-47d8-4697-9f9e-3e0e83e756f9 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:04:24.849296 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-76dbba78-47d8-4697-9f9e-3e0e83e756f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:04:24.857447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 556/1111] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:04:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:04:24.865252 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da35c89-0826-4d56-9d9f-f065ebe62037 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:24.865774 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da35c89-0826-4d56-9d9f-f065ebe62037 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:24.865879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da35c89-0826-4d56-9d9f-f065ebe62037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:24.884427 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-1da35c89-0826-4d56-9d9f-f065ebe62037 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:04:24.885642 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-1da35c89-0826-4d56-9d9f-f065ebe62037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:04:24.894172 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 556/1112] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:04:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:04:24.898867 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbba78-47d8-4697-9f9e-3e0e83e756f9 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:04:24.908406 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbba78-47d8-4697-9f9e-3e0e83e756f9 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:04:24.912955 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69ffe1-bf80-4cf3-a9df-323c00f4729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:04:24.913598 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69ffe1-bf80-4cf3-a9df-323c00f4729d admin admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:24.913878 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69ffe1-bf80-4cf3-a9df-323c00f4729d admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:24.914150 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69ffe1-bf80-4cf3-a9df-323c00f4729d admin admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:24.914893 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69ffe1-bf80-4cf3-a9df-323c00f4729d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 12:04:24.915195 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69ffe1-bf80-4cf3-a9df-323c00f4729d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:04:24.916192 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: WARNING py.warnings [None req-bb69ffe1-bf80-4cf3-a9df-323c00f4729d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 12:04:24.916192 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: warnings.warn(msg) Jul 11 12:04:24.916192 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: Jul 11 12:04:24.917065 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69ffe1-bf80-4cf3-a9df-323c00f4729d admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:04:24.928296 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 557/1113] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Jul 11 12:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 12:04:24.936188 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da35c89-0826-4d56-9d9f-f065ebe62037 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:04:24.946119 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da35c89-0826-4d56-9d9f-f065ebe62037 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:04:24.950662 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28699129-7763-4161-8055-a54a6ed945c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:04:24.951330 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28699129-7763-4161-8055-a54a6ed945c1 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:24.951615 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28699129-7763-4161-8055-a54a6ed945c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:24.951888 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28699129-7763-4161-8055-a54a6ed945c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:24.952574 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28699129-7763-4161-8055-a54a6ed945c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:04:24.954352 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: WARNING py.warnings [None req-28699129-7763-4161-8055-a54a6ed945c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 12:04:24.954352 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: warnings.warn(msg) Jul 11 12:04:24.954352 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: Jul 11 12:04:24.955610 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28699129-7763-4161-8055-a54a6ed945c1 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:04:24.981232 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 557/1114] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Jul 11 12:04:24 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 12:04:24.985226 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69ffe1-bf80-4cf3-a9df-323c00f4729d admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:04:24.995766 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69ffe1-bf80-4cf3-a9df-323c00f4729d admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:04:25.053812 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fa291-4a08-4d26-827a-20b8ac02d5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:04:25.054477 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fa291-4a08-4d26-827a-20b8ac02d5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:25.054795 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fa291-4a08-4d26-827a-20b8ac02d5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:25.055076 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fa291-4a08-4d26-827a-20b8ac02d5a9 admin admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:25.055768 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fa291-4a08-4d26-827a-20b8ac02d5a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:04:25.056814 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: WARNING py.warnings [None req-4c9fa291-4a08-4d26-827a-20b8ac02d5a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 12:04:25.056814 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: warnings.warn(msg) Jul 11 12:04:25.056814 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: Jul 11 12:04:25.058050 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fa291-4a08-4d26-827a-20b8ac02d5a9 admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:04:25.078348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 558/1115] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Jul 11 12:04:24 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 12:04:25.083597 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28699129-7763-4161-8055-a54a6ed945c1 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:04:25.093601 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28699129-7763-4161-8055-a54a6ed945c1 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:04:25.099124 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7366e73-f188-43cc-bd3e-5a1af6b24d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:04:25.099789 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7366e73-f188-43cc-bd3e-5a1af6b24d93 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:25.100096 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7366e73-f188-43cc-bd3e-5a1af6b24d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:25.100350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7366e73-f188-43cc-bd3e-5a1af6b24d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:25.101076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7366e73-f188-43cc-bd3e-5a1af6b24d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:04:25.102195 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: WARNING py.warnings [None req-a7366e73-f188-43cc-bd3e-5a1af6b24d93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 12:04:25.102195 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: warnings.warn(msg) Jul 11 12:04:25.102195 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: Jul 11 12:04:25.102998 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7366e73-f188-43cc-bd3e-5a1af6b24d93 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:04:25.117127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 558/1116] 10.222.0.25 () {58 vars in 1121 bytes} [Mon Jul 11 12:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 12:04:25.121264 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fa291-4a08-4d26-827a-20b8ac02d5a9 admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:04:25.131595 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fa291-4a08-4d26-827a-20b8ac02d5a9 admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:04:25.136176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc7ca8-3272-43a3-949b-659260ff90d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:04:25.136826 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc7ca8-3272-43a3-949b-659260ff90d8 admin admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:25.137108 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc7ca8-3272-43a3-949b-659260ff90d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:25.137384 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc7ca8-3272-43a3-949b-659260ff90d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:25.138097 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc7ca8-3272-43a3-949b-659260ff90d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:04:25.139140 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: WARNING py.warnings [None req-5efc7ca8-3272-43a3-949b-659260ff90d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 12:04:25.139140 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: warnings.warn(msg) Jul 11 12:04:25.139140 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: Jul 11 12:04:25.140023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc7ca8-3272-43a3-949b-659260ff90d8 admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:04:25.154628 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 559/1117] 10.222.0.25 () {58 vars in 1121 bytes} [Mon Jul 11 12:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 12:04:25.158660 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7366e73-f188-43cc-bd3e-5a1af6b24d93 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:04:25.169626 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7366e73-f188-43cc-bd3e-5a1af6b24d93 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:04:25.174136 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fd5fc-fcfb-428e-ac71-1c29b8458df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:04:25.175591 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fd5fc-fcfb-428e-ac71-1c29b8458df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:25.175915 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fd5fc-fcfb-428e-ac71-1c29b8458df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:25.176189 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fd5fc-fcfb-428e-ac71-1c29b8458df5 admin admin] PATH_INFO: `/v3/projects/d45898cddcb54aadbaa2dc665ecaef28/users/0c775adc29bd4bddb546a91c4684bdda/roles/a4345a1838084e3494c3e85dfb3225b4` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:25.191491 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fd5fc-fcfb-428e-ac71-1c29b8458df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45898cddcb54aadbaa2dc665ecaef28, user_id=0c775adc29bd4bddb546a91c4684bdda, role_id=a4345a1838084e3494c3e85dfb3225b4)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:04:25.192507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: WARNING py.warnings [None req-346fd5fc-fcfb-428e-ac71-1c29b8458df5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 12:04:25.192507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: warnings.warn(msg) Jul 11 12:04:25.192507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: Jul 11 12:04:25.194459 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fd5fc-fcfb-428e-ac71-1c29b8458df5 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:04:25.207015 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 559/1118] 10.222.0.25 () {60 vars in 1482 bytes} [Mon Jul 11 12:04:25 2022] PUT /identity/v3/projects/d45898cddcb54aadbaa2dc665ecaef28/users/0c775adc29bd4bddb546a91c4684bdda/roles/a4345a1838084e3494c3e85dfb3225b4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 12:04:25.218849 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd81de-d92e-4949-9d22-d16b4894003c None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:25.219145 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd81de-d92e-4949-9d22-d16b4894003c None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:25.219424 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd81de-d92e-4949-9d22-d16b4894003c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:25.246056 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-26dd81de-d92e-4949-9d22-d16b4894003c None None] MFA Rules not processed for user `0c775adc29bd4bddb546a91c4684bdda`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:04:25.247299 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-26dd81de-d92e-4949-9d22-d16b4894003c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:04:25.309185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 560/1119] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:04:25 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:04:25.323131 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcc7de-1812-4b41-a3a5-c9b809cb4fa4 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:25.323425 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcc7de-1812-4b41-a3a5-c9b809cb4fa4 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:25.323706 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcc7de-1812-4b41-a3a5-c9b809cb4fa4 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:25.325071 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 560/1120] 10.222.0.25 () {54 vars in 963 bytes} [Mon Jul 11 12:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:04:25.329894 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e7e1f-8b4c-487c-9470-6286574c8689 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:25.330180 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e7e1f-8b4c-487c-9470-6286574c8689 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:25.330458 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e7e1f-8b4c-487c-9470-6286574c8689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:25.348731 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-9a5e7e1f-8b4c-487c-9470-6286574c8689 None None] MFA Rules not processed for user `009ac389925143f1954c5d1971155318`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:04:25.349850 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-9a5e7e1f-8b4c-487c-9470-6286574c8689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:04:25.393168 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:04:25.401989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 561/1121] 10.222.0.25 () {58 vars in 1060 bytes} [Mon Jul 11 12:04:25 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:04:25.410221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcc7de-1812-4b41-a3a5-c9b809cb4fa4 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:04:25.420680 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcc7de-1812-4b41-a3a5-c9b809cb4fa4 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:04:25.424150 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c88d1-960b-402d-9262-8a83d9026145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009ac389925143f1954c5d1971155318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:04:25.425362 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c88d1-960b-402d-9262-8a83d9026145 service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:25.425645 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c88d1-960b-402d-9262-8a83d9026145 service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:25.425921 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c88d1-960b-402d-9262-8a83d9026145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:25.434024 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c88d1-960b-402d-9262-8a83d9026145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:04:25.435489 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c88d1-960b-402d-9262-8a83d9026145 service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:04:25.444227 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 561/1122] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:04:25 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:04:25.479024 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f83b6-ba1b-4398-acc1-b50a7eb4db5e None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:25.479315 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f83b6-ba1b-4398-acc1-b50a7eb4db5e None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:25.479594 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f83b6-ba1b-4398-acc1-b50a7eb4db5e None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:25.481152 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 562/1123] 10.222.0.25 () {52 vars in 829 bytes} [Mon Jul 11 12:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:04:25.484700 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c88d1-960b-402d-9262-8a83d9026145 service cinder] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:04:25.545640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c88d1-960b-402d-9262-8a83d9026145 service cinder] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:04:25.550248 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d2846-cc7e-4002-ab20-ff2e99f27030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:04:25.551129 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d2846-cc7e-4002-ab20-ff2e99f27030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:25.551412 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d2846-cc7e-4002-ab20-ff2e99f27030 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:25.551680 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d2846-cc7e-4002-ab20-ff2e99f27030 admin admin] PATH_INFO: `/v3/users/0c775adc29bd4bddb546a91c4684bdda` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:25.552863 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d2846-cc7e-4002-ab20-ff2e99f27030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c775adc29bd4bddb546a91c4684bdda)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:04:25.553873 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: WARNING py.warnings [None req-ed5d2846-cc7e-4002-ab20-ff2e99f27030 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 12:04:25.553873 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: warnings.warn(msg) Jul 11 12:04:25.553873 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: Jul 11 12:04:25.555121 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d2846-cc7e-4002-ab20-ff2e99f27030 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:04:25.618659 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ed5d2846-cc7e-4002-ab20-ff2e99f27030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c775adc29bd4bddb546a91c4684bdda'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:04:25.639341 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ed5d2846-cc7e-4002-ab20-ff2e99f27030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c775adc29bd4bddb546a91c4684bdda'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:04:25.640081 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ed5d2846-cc7e-4002-ab20-ff2e99f27030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c775adc29bd4bddb546a91c4684bdda'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:04:25.652886 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ed5d2846-cc7e-4002-ab20-ff2e99f27030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c775adc29bd4bddb546a91c4684bdda'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:04:25.653635 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-ed5d2846-cc7e-4002-ab20-ff2e99f27030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c775adc29bd4bddb546a91c4684bdda'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:04:25.668563 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 562/1124] 10.222.0.25 () {58 vars in 1223 bytes} [Mon Jul 11 12:04:25 2022] DELETE /identity/v3/users/0c775adc29bd4bddb546a91c4684bdda => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 12:04:25.673022 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b23e6-2723-4c3d-89cb-79624388fca0 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:25.673337 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b23e6-2723-4c3d-89cb-79624388fca0 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:25.673638 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b23e6-2723-4c3d-89cb-79624388fca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:25.691370 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-511b23e6-2723-4c3d-89cb-79624388fca0 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:04:25.692547 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-511b23e6-2723-4c3d-89cb-79624388fca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:04:25.753663 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 563/1125] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:04:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:04:25.762800 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d2846-cc7e-4002-ab20-ff2e99f27030 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:04:25.764244 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-ed5d2846-cc7e-4002-ab20-ff2e99f27030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:04:25.770705 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:04:25.828365 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d2846-cc7e-4002-ab20-ff2e99f27030 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:04:25.832070 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82507e-07c0-4a3b-a0a0-d5ab59fdb814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:04:25.832710 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82507e-07c0-4a3b-a0a0-d5ab59fdb814 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:25.832993 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82507e-07c0-4a3b-a0a0-d5ab59fdb814 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:25.833267 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82507e-07c0-4a3b-a0a0-d5ab59fdb814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:25.842058 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82507e-07c0-4a3b-a0a0-d5ab59fdb814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:04:25.843538 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82507e-07c0-4a3b-a0a0-d5ab59fdb814 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:04:25.852959 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 563/1126] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:04:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:04:26.205631 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b23e6-2723-4c3d-89cb-79624388fca0 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:04:26.208072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-511b23e6-2723-4c3d-89cb-79624388fca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:04:26.220212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b23e6-2723-4c3d-89cb-79624388fca0 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:04:26.225062 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288636ef-d966-4d9f-a989-a9ea8ce3b7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:04:26.225937 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288636ef-d966-4d9f-a989-a9ea8ce3b7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:04:26.226214 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288636ef-d966-4d9f-a989-a9ea8ce3b7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:04:26.226487 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288636ef-d966-4d9f-a989-a9ea8ce3b7e3 admin admin] PATH_INFO: `/v3/projects/d45898cddcb54aadbaa2dc665ecaef28` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:04:26.227704 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288636ef-d966-4d9f-a989-a9ea8ce3b7e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d45898cddcb54aadbaa2dc665ecaef28)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:04:26.228752 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: WARNING py.warnings [None req-288636ef-d966-4d9f-a989-a9ea8ce3b7e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 12:04:26.228752 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: warnings.warn(msg) Jul 11 12:04:26.228752 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: Jul 11 12:04:26.229979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288636ef-d966-4d9f-a989-a9ea8ce3b7e3 admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:04:26.290911 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-288636ef-d966-4d9f-a989-a9ea8ce3b7e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd45898cddcb54aadbaa2dc665ecaef28', 'request_id': 'req-288636ef-d966-4d9f-a989-a9ea8ce3b7e3'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:04:26.300605 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-288636ef-d966-4d9f-a989-a9ea8ce3b7e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd45898cddcb54aadbaa2dc665ecaef28', 'request_id': 'req-288636ef-d966-4d9f-a989-a9ea8ce3b7e3'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:04:26.314273 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-288636ef-d966-4d9f-a989-a9ea8ce3b7e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd45898cddcb54aadbaa2dc665ecaef28', 'request_id': 'req-288636ef-d966-4d9f-a989-a9ea8ce3b7e3'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:04:26.325754 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-288636ef-d966-4d9f-a989-a9ea8ce3b7e3 admin admin] The token cache is being invalidate because project d45898cddcb54aadbaa2dc665ecaef28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87217) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 12:04:26.326056 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-288636ef-d966-4d9f-a989-a9ea8ce3b7e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:04:26.326674 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-288636ef-d966-4d9f-a989-a9ea8ce3b7e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:04:26.328366 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 564/1127] 10.222.0.25 () {58 vars in 1232 bytes} [Mon Jul 11 12:04:26 2022] DELETE /identity/v3/projects/d45898cddcb54aadbaa2dc665ecaef28 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 12:04:35.848751 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=25 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:04:36.322852 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:05:50.630240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b427c-3a2a-42fa-8831-5d17c32df1ad None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:05:50.630858 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b427c-3a2a-42fa-8831-5d17c32df1ad None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:05:50.630858 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b427c-3a2a-42fa-8831-5d17c32df1ad None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:05:50.632191 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 564/1128] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 12:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:05:50.637141 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb8586-c7e0-46ae-81e9-de74d7d108d4 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:05:50.637550 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb8586-c7e0-46ae-81e9-de74d7d108d4 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:05:50.637704 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb8586-c7e0-46ae-81e9-de74d7d108d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:05:50.704926 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-5beb8586-c7e0-46ae-81e9-de74d7d108d4 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:05:50.706117 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-5beb8586-c7e0-46ae-81e9-de74d7d108d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:05:50.798997 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 565/1129] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 12:05:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:05:50.959594 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b427c-3a2a-42fa-8831-5d17c32df1ad None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:05:50.961368 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-af8b427c-3a2a-42fa-8831-5d17c32df1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:05:51.050302 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b427c-3a2a-42fa-8831-5d17c32df1ad None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:05:51.055530 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8520ccc-464d-4343-aeb8-53f47f18dab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:05:51.056182 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8520ccc-464d-4343-aeb8-53f47f18dab8 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:05:51.056465 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8520ccc-464d-4343-aeb8-53f47f18dab8 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:05:51.056741 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8520ccc-464d-4343-aeb8-53f47f18dab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:05:51.064833 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8520ccc-464d-4343-aeb8-53f47f18dab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:05:51.067066 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8520ccc-464d-4343-aeb8-53f47f18dab8 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:05:51.076376 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 565/1130] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:05:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:05:51.921696 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc6556-cc0e-48e6-ba78-7b1925ee1e1e None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:05:51.922280 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc6556-cc0e-48e6-ba78-7b1925ee1e1e None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:05:51.922280 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc6556-cc0e-48e6-ba78-7b1925ee1e1e None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:05:51.923689 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 566/1131] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 12:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:05:51.928587 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e384994-b960-4fb5-9ee9-a3a39ed33320 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:05:51.928974 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e384994-b960-4fb5-9ee9-a3a39ed33320 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:05:51.929153 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e384994-b960-4fb5-9ee9-a3a39ed33320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:05:51.947335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-8e384994-b960-4fb5-9ee9-a3a39ed33320 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:05:51.948533 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8e384994-b960-4fb5-9ee9-a3a39ed33320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:05:51.956492 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 566/1132] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 12:05:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:05:52.114914 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc6556-cc0e-48e6-ba78-7b1925ee1e1e None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:05:52.128533 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc6556-cc0e-48e6-ba78-7b1925ee1e1e None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:05:52.133933 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca8e11-29b1-4907-93ae-4f273444ee5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:05:52.134603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca8e11-29b1-4907-93ae-4f273444ee5b service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:05:52.134916 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca8e11-29b1-4907-93ae-4f273444ee5b service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:05:52.135212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca8e11-29b1-4907-93ae-4f273444ee5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:05:52.144028 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca8e11-29b1-4907-93ae-4f273444ee5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:05:52.146223 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca8e11-29b1-4907-93ae-4f273444ee5b service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:05:52.155658 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 567/1133] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:05:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:05:56.884807 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f41dd-326c-4d73-ba0d-f1e14da15b76 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:05:56.885340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f41dd-326c-4d73-ba0d-f1e14da15b76 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:05:56.885340 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f41dd-326c-4d73-ba0d-f1e14da15b76 None None] PATH_INFO: `/v3` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:05:56.886662 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 567/1134] 10.222.0.36 () {54 vars in 925 bytes} [Mon Jul 11 12:05:56 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 12:05:56.892490 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af88b5-543d-4282-891d-cc6aa6b5f7cc None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:05:56.892877 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af88b5-543d-4282-891d-cc6aa6b5f7cc None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:05:56.893054 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af88b5-543d-4282-891d-cc6aa6b5f7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:05:56.922342 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-07af88b5-543d-4282-891d-cc6aa6b5f7cc None None] MFA Rules not processed for user `fc6d2bcfca0a495582d322494b054045`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:05:56.923560 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-07af88b5-543d-4282-891d-cc6aa6b5f7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:05:56.976549 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:05:56.986866 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 568/1135] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Jul 11 12:05:56 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:06:01.942666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=42 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:06:03.391322 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c6f01-c09a-447a-90db-b6feedc62c63 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:03.391980 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c6f01-c09a-447a-90db-b6feedc62c63 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:03.391980 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c6f01-c09a-447a-90db-b6feedc62c63 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:03.393253 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 568/1136] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 12:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:06:03.398973 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74843f-c1e4-499d-9c2a-3242e30bcb40 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:03.399414 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74843f-c1e4-499d-9c2a-3242e30bcb40 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:03.399511 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74843f-c1e4-499d-9c2a-3242e30bcb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:03.417724 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-1a74843f-c1e4-499d-9c2a-3242e30bcb40 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:06:03.418951 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-1a74843f-c1e4-499d-9c2a-3242e30bcb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:06:03.426699 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 569/1137] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 12:06:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:06:03.584415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c6f01-c09a-447a-90db-b6feedc62c63 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:06:03.597684 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c6f01-c09a-447a-90db-b6feedc62c63 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:06:03.603356 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c4871-6b62-43c9-ab6e-2fc999ef74f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:06:03.603981 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c4871-6b62-43c9-ab6e-2fc999ef74f2 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:03.604260 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c4871-6b62-43c9-ab6e-2fc999ef74f2 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:03.604531 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c4871-6b62-43c9-ab6e-2fc999ef74f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:03.612983 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c4871-6b62-43c9-ab6e-2fc999ef74f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:06:03.615237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c4871-6b62-43c9-ab6e-2fc999ef74f2 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:06:03.625553 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 569/1138] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:06:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:06:04.469138 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f76e0-1b71-495b-be5c-44b9d15f23ee None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:04.469665 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f76e0-1b71-495b-be5c-44b9d15f23ee None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:04.469665 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f76e0-1b71-495b-be5c-44b9d15f23ee None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:04.470992 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 570/1139] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 12:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:06:04.475982 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887675c-2336-4ebb-944c-9da2f6a5998e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:04.476411 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887675c-2336-4ebb-944c-9da2f6a5998e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:04.476550 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887675c-2336-4ebb-944c-9da2f6a5998e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:04.494819 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-4887675c-2336-4ebb-944c-9da2f6a5998e None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:06:04.496014 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4887675c-2336-4ebb-944c-9da2f6a5998e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:06:04.503858 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 570/1140] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 12:06:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:06:04.660073 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f76e0-1b71-495b-be5c-44b9d15f23ee None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:06:04.673687 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f76e0-1b71-495b-be5c-44b9d15f23ee None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:06:04.679457 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde5e9c-13a8-4050-b686-ba5b81b15dbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:06:04.680088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde5e9c-13a8-4050-b686-ba5b81b15dbe service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:04.680373 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde5e9c-13a8-4050-b686-ba5b81b15dbe service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:04.680651 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde5e9c-13a8-4050-b686-ba5b81b15dbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:04.688831 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde5e9c-13a8-4050-b686-ba5b81b15dbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:06:04.690412 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde5e9c-13a8-4050-b686-ba5b81b15dbe service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:06:04.700379 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 571/1141] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:06:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:06:06.032951 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781cb1e-694a-474b-838c-a71a66426e15 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:06.033501 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781cb1e-694a-474b-838c-a71a66426e15 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:06.033501 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781cb1e-694a-474b-838c-a71a66426e15 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:06.034963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 571/1142] 10.222.0.25 () {54 vars in 960 bytes} [Mon Jul 11 12:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:06:06.040247 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3866e9-4a43-4d9c-80a9-7719fa51f40c None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:06.040656 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3866e9-4a43-4d9c-80a9-7719fa51f40c None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:06.040794 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3866e9-4a43-4d9c-80a9-7719fa51f40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:06.058447 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-2b3866e9-4a43-4d9c-80a9-7719fa51f40c None None] MFA Rules not processed for user `fc6d2bcfca0a495582d322494b054045`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:06:06.059647 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-2b3866e9-4a43-4d9c-80a9-7719fa51f40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:06:06.068482 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 572/1143] 10.222.0.25 () {58 vars in 1057 bytes} [Mon Jul 11 12:06:06 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:06:06.075672 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781cb1e-694a-474b-838c-a71a66426e15 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:06:06.089514 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781cb1e-694a-474b-838c-a71a66426e15 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:06:06.094589 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260b691-d2d4-4fc7-93fd-80bb2cfe65af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6d2bcfca0a495582d322494b054045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:06:06.095258 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b691-d2d4-4fc7-93fd-80bb2cfe65af service placement] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:06.095539 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b691-d2d4-4fc7-93fd-80bb2cfe65af service placement] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:06.095808 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b691-d2d4-4fc7-93fd-80bb2cfe65af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:06.104149 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260b691-d2d4-4fc7-93fd-80bb2cfe65af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:06:06.105758 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260b691-d2d4-4fc7-93fd-80bb2cfe65af service placement] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:06:06.116026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 572/1144] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:06:06 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 12:06:15.944959 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49a7ba-2e04-43d4-940b-5beddc45a8b4 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:15.945543 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49a7ba-2e04-43d4-940b-5beddc45a8b4 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:15.945543 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49a7ba-2e04-43d4-940b-5beddc45a8b4 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:15.946932 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 573/1145] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 12:06:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:06:15.951623 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00dc88-d16c-480a-9bb3-f405f58e885a None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:15.951997 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00dc88-d16c-480a-9bb3-f405f58e885a None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:15.952178 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00dc88-d16c-480a-9bb3-f405f58e885a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:15.970322 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-bb00dc88-d16c-480a-9bb3-f405f58e885a None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:06:15.971546 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-bb00dc88-d16c-480a-9bb3-f405f58e885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:06:15.979983 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 573/1146] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 12:06:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:06:16.053904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=12 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:06:16.139542 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49a7ba-2e04-43d4-940b-5beddc45a8b4 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:06:16.153586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49a7ba-2e04-43d4-940b-5beddc45a8b4 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:06:16.158624 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114ce08-aec5-40c8-9676-be004d618050 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:06:16.159299 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114ce08-aec5-40c8-9676-be004d618050 service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:16.159578 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114ce08-aec5-40c8-9676-be004d618050 service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:16.159851 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114ce08-aec5-40c8-9676-be004d618050 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:16.169373 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114ce08-aec5-40c8-9676-be004d618050 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:06:16.171059 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114ce08-aec5-40c8-9676-be004d618050 service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:06:16.180945 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 574/1147] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:06:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:06:16.997880 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050534-cdfb-4c38-b21b-e4e40f5082c5 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:16.998416 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050534-cdfb-4c38-b21b-e4e40f5082c5 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:16.998416 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050534-cdfb-4c38-b21b-e4e40f5082c5 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:16.999846 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 574/1148] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 12:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:06:17.004619 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab76a96-dc72-4a89-9dff-ea07d7418f6c None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:17.005040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab76a96-dc72-4a89-9dff-ea07d7418f6c None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:17.005151 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab76a96-dc72-4a89-9dff-ea07d7418f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:17.025570 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-cab76a96-dc72-4a89-9dff-ea07d7418f6c None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:06:17.026826 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-cab76a96-dc72-4a89-9dff-ea07d7418f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:06:17.034779 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 575/1149] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 12:06:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:06:17.202542 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050534-cdfb-4c38-b21b-e4e40f5082c5 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:06:17.216588 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050534-cdfb-4c38-b21b-e4e40f5082c5 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:06:17.221540 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f8980-c2dc-4d63-9a99-2cce879f5b47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:06:17.222171 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f8980-c2dc-4d63-9a99-2cce879f5b47 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:17.222455 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f8980-c2dc-4d63-9a99-2cce879f5b47 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:17.222755 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f8980-c2dc-4d63-9a99-2cce879f5b47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:17.230880 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f8980-c2dc-4d63-9a99-2cce879f5b47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:06:17.232722 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f8980-c2dc-4d63-9a99-2cce879f5b47 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:06:17.241980 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 575/1150] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:06:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:06:21.429061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff915813-ed5a-465c-88aa-57b394ce3991 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:21.429700 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff915813-ed5a-465c-88aa-57b394ce3991 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:21.429700 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff915813-ed5a-465c-88aa-57b394ce3991 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:21.431029 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 576/1151] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 12:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:06:21.436081 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbfde6-728a-49ab-89b8-bb572f89b126 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:21.436597 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbfde6-728a-49ab-89b8-bb572f89b126 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:21.436699 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbfde6-728a-49ab-89b8-bb572f89b126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:21.455255 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-33bbfde6-728a-49ab-89b8-bb572f89b126 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:06:21.456440 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-33bbfde6-728a-49ab-89b8-bb572f89b126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:06:21.465002 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 576/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 12:06:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:06:21.502392 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff915813-ed5a-465c-88aa-57b394ce3991 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:06:21.504090 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-ff915813-ed5a-465c-88aa-57b394ce3991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:06:21.560416 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff915813-ed5a-465c-88aa-57b394ce3991 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:06:21.563882 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0ac45-e4a8-481a-9c0f-3081b4bae05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:06:21.564519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0ac45-e4a8-481a-9c0f-3081b4bae05a service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:21.564799 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0ac45-e4a8-481a-9c0f-3081b4bae05a service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:21.565070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0ac45-e4a8-481a-9c0f-3081b4bae05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:21.574535 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0ac45-e4a8-481a-9c0f-3081b4bae05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:06:21.575994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0ac45-e4a8-481a-9c0f-3081b4bae05a service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:06:21.585895 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 577/1153] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:06:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:06:23.771534 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78aedc9-1f26-41d9-8780-83bfe1c28cf6 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:23.772200 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78aedc9-1f26-41d9-8780-83bfe1c28cf6 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:23.772200 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78aedc9-1f26-41d9-8780-83bfe1c28cf6 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:23.773448 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 577/1154] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 12:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:06:23.778684 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9baaf-16b0-47e6-a851-cbfa1a36fdb7 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:23.779111 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9baaf-16b0-47e6-a851-cbfa1a36fdb7 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:23.779277 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9baaf-16b0-47e6-a851-cbfa1a36fdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:23.797344 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-5ff9baaf-16b0-47e6-a851-cbfa1a36fdb7 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:06:23.798525 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-5ff9baaf-16b0-47e6-a851-cbfa1a36fdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:06:23.806925 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 578/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 12:06:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:06:23.842242 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78aedc9-1f26-41d9-8780-83bfe1c28cf6 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:06:23.853650 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78aedc9-1f26-41d9-8780-83bfe1c28cf6 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:06:23.857402 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b3dd9-2fb6-4e08-8568-51c169058dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:06:23.858030 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b3dd9-2fb6-4e08-8568-51c169058dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:23.858344 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b3dd9-2fb6-4e08-8568-51c169058dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:23.858620 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b3dd9-2fb6-4e08-8568-51c169058dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:23.868697 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b3dd9-2fb6-4e08-8568-51c169058dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:06:23.870351 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b3dd9-2fb6-4e08-8568-51c169058dc7 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:06:23.880404 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 578/1156] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:06:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 12:06:27.672639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5981c13-61a1-4f3e-be2c-cd05d4e85de3 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:27.673200 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5981c13-61a1-4f3e-be2c-cd05d4e85de3 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:27.673200 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5981c13-61a1-4f3e-be2c-cd05d4e85de3 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:27.674567 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 579/1157] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 12:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:06:27.679679 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa977f7-6746-4e9d-a4f1-e4ce6416770c None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:27.680096 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa977f7-6746-4e9d-a4f1-e4ce6416770c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:27.680237 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa977f7-6746-4e9d-a4f1-e4ce6416770c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:27.698493 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-9aa977f7-6746-4e9d-a4f1-e4ce6416770c None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:06:27.699717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-9aa977f7-6746-4e9d-a4f1-e4ce6416770c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:06:27.707639 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 579/1158] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 12:06:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:06:27.982494 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5981c13-61a1-4f3e-be2c-cd05d4e85de3 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:06:27.984173 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-e5981c13-61a1-4f3e-be2c-cd05d4e85de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:06:28.041176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5981c13-61a1-4f3e-be2c-cd05d4e85de3 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:06:28.044708 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e93d4-2c03-4007-b66f-d0735c2d906a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009ac389925143f1954c5d1971155318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:06:28.045307 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e93d4-2c03-4007-b66f-d0735c2d906a service cinder] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:28.045593 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e93d4-2c03-4007-b66f-d0735c2d906a service cinder] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:28.045865 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e93d4-2c03-4007-b66f-d0735c2d906a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:28.055536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e93d4-2c03-4007-b66f-d0735c2d906a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:06:28.056961 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e93d4-2c03-4007-b66f-d0735c2d906a service cinder] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:06:28.066327 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 580/1159] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:06:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:06:30.357937 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8866dcb-1abb-47b4-821c-985491a05c58 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:30.358428 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8866dcb-1abb-47b4-821c-985491a05c58 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:30.358536 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8866dcb-1abb-47b4-821c-985491a05c58 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:30.359889 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 580/1160] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 12:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:06:30.365659 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c7856-fd3b-458c-a58f-65cdba42d774 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:30.366097 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c7856-fd3b-458c-a58f-65cdba42d774 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:30.366216 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c7856-fd3b-458c-a58f-65cdba42d774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:30.385632 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-cd1c7856-fd3b-458c-a58f-65cdba42d774 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:06:30.386864 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-cd1c7856-fd3b-458c-a58f-65cdba42d774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:06:30.394666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 581/1161] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 12:06:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:06:30.662583 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8866dcb-1abb-47b4-821c-985491a05c58 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:06:30.664255 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-d8866dcb-1abb-47b4-821c-985491a05c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:06:30.676921 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8866dcb-1abb-47b4-821c-985491a05c58 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:06:30.680808 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9edce-a3a0-4f3c-abf0-2aab1bf6e3ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009ac389925143f1954c5d1971155318', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:06:30.681430 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9edce-a3a0-4f3c-abf0-2aab1bf6e3ec service cinder] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:06:30.681709 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9edce-a3a0-4f3c-abf0-2aab1bf6e3ec service cinder] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:06:30.681982 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9edce-a3a0-4f3c-abf0-2aab1bf6e3ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:06:30.690792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9edce-a3a0-4f3c-abf0-2aab1bf6e3ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:06:30.692213 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9edce-a3a0-4f3c-abf0-2aab1bf6e3ec service cinder] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:06:30.701963 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 581/1162] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:06:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:06:40.380507 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=67 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:06:40.697912 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=42 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:07:50.312291 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2ae19-beae-4678-9d84-6799b1386208 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.312912 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2ae19-beae-4678-9d84-6799b1386208 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.312912 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2ae19-beae-4678-9d84-6799b1386208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.331446 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-4bf2ae19-beae-4678-9d84-6799b1386208 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:07:50.332680 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-4bf2ae19-beae-4678-9d84-6799b1386208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:07:50.340620 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 582/1163] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:07:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:07:50.342951 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5ae45-7404-485d-9a57-acfade8490eb None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.343475 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5ae45-7404-485d-9a57-acfade8490eb None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.343586 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5ae45-7404-485d-9a57-acfade8490eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.348518 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c0bc-c8dc-459e-a7f9-8c4bf72fc349 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.348810 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c0bc-c8dc-459e-a7f9-8c4bf72fc349 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.349095 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56c0bc-c8dc-459e-a7f9-8c4bf72fc349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.362424 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-0dd5ae45-7404-485d-9a57-acfade8490eb None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:07:50.363677 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-0dd5ae45-7404-485d-9a57-acfade8490eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:07:50.367348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-3b56c0bc-c8dc-459e-a7f9-8c4bf72fc349 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:07:50.368508 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-3b56c0bc-c8dc-459e-a7f9-8c4bf72fc349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:07:50.372574 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 582/1164] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:07:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:07:50.381301 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65fc39-6688-4103-9fd0-70b986bb65fa None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.381591 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65fc39-6688-4103-9fd0-70b986bb65fa None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.381874 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65fc39-6688-4103-9fd0-70b986bb65fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.383632 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 583/1165] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:07:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:07:50.387907 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56c0bc-c8dc-459e-a7f9-8c4bf72fc349 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:50.396771 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56c0bc-c8dc-459e-a7f9-8c4bf72fc349 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:50.401173 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-4b65fc39-6688-4103-9fd0-70b986bb65fa None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:07:50.401309 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3e3ec-2fd9-4b63-9821-edf7ea783c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:50.401951 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3e3ec-2fd9-4b63-9821-edf7ea783c31 admin admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.402230 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3e3ec-2fd9-4b63-9821-edf7ea783c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.402368 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-4b65fc39-6688-4103-9fd0-70b986bb65fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:07:50.402503 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3e3ec-2fd9-4b63-9821-edf7ea783c31 admin admin] PATH_INFO: `/v3/domains` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.403259 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3e3ec-2fd9-4b63-9821-edf7ea783c31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87217) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 12:07:50.403561 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3e3ec-2fd9-4b63-9821-edf7ea783c31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:50.405140 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3e3ec-2fd9-4b63-9821-edf7ea783c31 admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:50.410331 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 583/1166] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:07:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:07:50.415025 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65fc39-6688-4103-9fd0-70b986bb65fa None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:50.419208 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 584/1167] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Jul 11 12:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 12:07:50.424014 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65fc39-6688-4103-9fd0-70b986bb65fa None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:50.427714 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3e3ec-2fd9-4b63-9821-edf7ea783c31 admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:50.429982 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7ab99-45f3-4aff-af1b-35b519c1c0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:50.430836 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7ab99-45f3-4aff-af1b-35b519c1c0fb admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.431282 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7ab99-45f3-4aff-af1b-35b519c1c0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.431726 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7ab99-45f3-4aff-af1b-35b519c1c0fb admin admin] PATH_INFO: `/v3/domains` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.432607 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7ab99-45f3-4aff-af1b-35b519c1c0fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87216) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 12:07:50.433071 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7ab99-45f3-4aff-af1b-35b519c1c0fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:50.434240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: WARNING py.warnings [None req-b0f7ab99-45f3-4aff-af1b-35b519c1c0fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 12:07:50.434240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: warnings.warn(msg) Jul 11 12:07:50.434240 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: Jul 11 12:07:50.435176 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7ab99-45f3-4aff-af1b-35b519c1c0fb admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:50.438827 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3e3ec-2fd9-4b63-9821-edf7ea783c31 admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:50.444336 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616b532-1939-4e27-9382-22bf0293e451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:50.444980 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616b532-1939-4e27-9382-22bf0293e451 admin admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.445256 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616b532-1939-4e27-9382-22bf0293e451 admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.445522 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616b532-1939-4e27-9382-22bf0293e451 admin admin] PATH_INFO: `/v3/projects` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.446197 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616b532-1939-4e27-9382-22bf0293e451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:50.447234 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: WARNING py.warnings [None req-7616b532-1939-4e27-9382-22bf0293e451 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 12:07:50.447234 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: warnings.warn(msg) Jul 11 12:07:50.447234 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: Jul 11 12:07:50.448195 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 584/1168] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Jul 11 12:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 12:07:50.448550 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616b532-1939-4e27-9382-22bf0293e451 admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:50.456104 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7ab99-45f3-4aff-af1b-35b519c1c0fb admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:50.465904 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7ab99-45f3-4aff-af1b-35b519c1c0fb admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:50.470656 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c12c17-d029-48c6-9d22-f4399c010c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:50.471329 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c12c17-d029-48c6-9d22-f4399c010c85 admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.471615 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c12c17-d029-48c6-9d22-f4399c010c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.471894 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c12c17-d029-48c6-9d22-f4399c010c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.472565 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c12c17-d029-48c6-9d22-f4399c010c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:50.474889 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c12c17-d029-48c6-9d22-f4399c010c85 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:50.484181 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 585/1169] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Jul 11 12:07:50 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 12:07:50.488485 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616b532-1939-4e27-9382-22bf0293e451 admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:50.502837 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 585/1170] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Jul 11 12:07:50 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 12:07:50.507560 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c12c17-d029-48c6-9d22-f4399c010c85 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:50.555286 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616b532-1939-4e27-9382-22bf0293e451 admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:50.576620 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c12c17-d029-48c6-9d22-f4399c010c85 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:50.581841 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fae415-a423-4aae-aeca-38d781669a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:50.582511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fae415-a423-4aae-aeca-38d781669a7b admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.583364 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fae415-a423-4aae-aeca-38d781669a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.583652 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fae415-a423-4aae-aeca-38d781669a7b admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.584356 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fae415-a423-4aae-aeca-38d781669a7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:50.585378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: WARNING py.warnings [None req-43fae415-a423-4aae-aeca-38d781669a7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 12:07:50.585378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: warnings.warn(msg) Jul 11 12:07:50.585378 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: Jul 11 12:07:50.586577 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fae415-a423-4aae-aeca-38d781669a7b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:50.607888 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 586/1171] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Jul 11 12:07:50 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 12:07:50.611633 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fae415-a423-4aae-aeca-38d781669a7b admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:50.613184 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802ff16-c0f0-4eae-ad6e-c72239019d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:50.613988 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802ff16-c0f0-4eae-ad6e-c72239019d21 admin admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.614396 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802ff16-c0f0-4eae-ad6e-c72239019d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.614774 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802ff16-c0f0-4eae-ad6e-c72239019d21 admin admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.615467 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802ff16-c0f0-4eae-ad6e-c72239019d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:50.617403 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802ff16-c0f0-4eae-ad6e-c72239019d21 admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:50.621394 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fae415-a423-4aae-aeca-38d781669a7b admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:50.626133 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71c9c8-1c82-4d3d-a6c4-5fda081d01c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:50.626879 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c9c8-1c82-4d3d-a6c4-5fda081d01c9 admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.627160 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c9c8-1c82-4d3d-a6c4-5fda081d01c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.627437 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c9c8-1c82-4d3d-a6c4-5fda081d01c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.628148 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71c9c8-1c82-4d3d-a6c4-5fda081d01c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:50.629749 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71c9c8-1c82-4d3d-a6c4-5fda081d01c9 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:50.637353 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 586/1172] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Jul 11 12:07:50 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 12:07:50.640057 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 587/1173] 10.222.0.25 () {58 vars in 1121 bytes} [Mon Jul 11 12:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 12:07:50.641563 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802ff16-c0f0-4eae-ad6e-c72239019d21 admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:50.643478 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71c9c8-1c82-4d3d-a6c4-5fda081d01c9 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:50.652031 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802ff16-c0f0-4eae-ad6e-c72239019d21 admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:50.653708 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71c9c8-1c82-4d3d-a6c4-5fda081d01c9 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:50.656585 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a2fc7-bc05-4bf9-99a1-6d35a82f3b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:50.657233 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a2fc7-bc05-4bf9-99a1-6d35a82f3b4b admin admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.657513 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a2fc7-bc05-4bf9-99a1-6d35a82f3b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.657790 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a2fc7-bc05-4bf9-99a1-6d35a82f3b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.658277 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ba51a-d098-4688-b72a-2ecad2c6c5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:50.658495 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a2fc7-bc05-4bf9-99a1-6d35a82f3b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:50.658938 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ba51a-d098-4688-b72a-2ecad2c6c5ab admin admin] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.659221 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ba51a-d098-4688-b72a-2ecad2c6c5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.659493 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ba51a-d098-4688-b72a-2ecad2c6c5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.660150 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a2fc7-bc05-4bf9-99a1-6d35a82f3b4b admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:50.660268 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ba51a-d098-4688-b72a-2ecad2c6c5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:50.662574 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ba51a-d098-4688-b72a-2ecad2c6c5ab admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:50.673631 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 587/1174] 10.222.0.25 () {58 vars in 1121 bytes} [Mon Jul 11 12:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 12:07:50.673782 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 588/1175] 10.222.0.25 () {58 vars in 1121 bytes} [Mon Jul 11 12:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 12:07:50.674645 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a2fc7-bc05-4bf9-99a1-6d35a82f3b4b admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:50.676966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ba51a-d098-4688-b72a-2ecad2c6c5ab admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:50.684437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a2fc7-bc05-4bf9-99a1-6d35a82f3b4b admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:50.686523 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ba51a-d098-4688-b72a-2ecad2c6c5ab admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:50.689019 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f508f9-b17b-4a25-b4c0-d72970062a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:50.689663 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f508f9-b17b-4a25-b4c0-d72970062a56 admin admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.689942 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f508f9-b17b-4a25-b4c0-d72970062a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.690213 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f508f9-b17b-4a25-b4c0-d72970062a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.690948 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f508f9-b17b-4a25-b4c0-d72970062a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:50.691166 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247799e-4256-48f9-8a9b-b3fdbd844c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:50.692530 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247799e-4256-48f9-8a9b-b3fdbd844c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.692818 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247799e-4256-48f9-8a9b-b3fdbd844c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.693056 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f508f9-b17b-4a25-b4c0-d72970062a56 admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:50.693207 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247799e-4256-48f9-8a9b-b3fdbd844c5f admin admin] PATH_INFO: `/v3/projects/2696c6e029fc42c1836959bf5a4f745a/users/5e39058d7a1e45e0b787c42841f59000/roles/a4345a1838084e3494c3e85dfb3225b4` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.703680 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 588/1176] 10.222.0.25 () {58 vars in 1121 bytes} [Mon Jul 11 12:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 12:07:50.707528 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f508f9-b17b-4a25-b4c0-d72970062a56 admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:50.709228 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247799e-4256-48f9-8a9b-b3fdbd844c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2696c6e029fc42c1836959bf5a4f745a, user_id=5e39058d7a1e45e0b787c42841f59000, role_id=a4345a1838084e3494c3e85dfb3225b4)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:50.711997 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247799e-4256-48f9-8a9b-b3fdbd844c5f admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:50.717747 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f508f9-b17b-4a25-b4c0-d72970062a56 admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:50.722435 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149a6f3-e1d2-4452-908e-01027caadb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:50.723873 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149a6f3-e1d2-4452-908e-01027caadb7c admin admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.724155 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149a6f3-e1d2-4452-908e-01027caadb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.724425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149a6f3-e1d2-4452-908e-01027caadb7c admin admin] PATH_INFO: `/v3/projects/967c43ae687c471e9bef79704d4e66e9/users/fe9a1dda0eb54af99dd4dc9849a10460/roles/a4345a1838084e3494c3e85dfb3225b4` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.725212 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 589/1177] 10.222.0.25 () {60 vars in 1482 bytes} [Mon Jul 11 12:07:50 2022] PUT /identity/v3/projects/2696c6e029fc42c1836959bf5a4f745a/users/5e39058d7a1e45e0b787c42841f59000/roles/a4345a1838084e3494c3e85dfb3225b4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 12:07:50.730165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be9a59-9855-4911-84ca-033e073bf332 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.730454 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be9a59-9855-4911-84ca-033e073bf332 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.730759 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be9a59-9855-4911-84ca-033e073bf332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.739998 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149a6f3-e1d2-4452-908e-01027caadb7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=967c43ae687c471e9bef79704d4e66e9, user_id=fe9a1dda0eb54af99dd4dc9849a10460, role_id=a4345a1838084e3494c3e85dfb3225b4)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:50.741017 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: WARNING py.warnings [None req-8149a6f3-e1d2-4452-908e-01027caadb7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 12:07:50.741017 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: warnings.warn(msg) Jul 11 12:07:50.741017 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: Jul 11 12:07:50.742983 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149a6f3-e1d2-4452-908e-01027caadb7c admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:50.745209 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:07:50.748428 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-71be9a59-9855-4911-84ca-033e073bf332 None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:07:50.749588 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-71be9a59-9855-4911-84ca-033e073bf332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:07:50.756486 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 589/1178] 10.222.0.25 () {60 vars in 1482 bytes} [Mon Jul 11 12:07:50 2022] PUT /identity/v3/projects/967c43ae687c471e9bef79704d4e66e9/users/fe9a1dda0eb54af99dd4dc9849a10460/roles/a4345a1838084e3494c3e85dfb3225b4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 12:07:50.761420 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6e275-0298-438d-9536-19003c6f314b None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.761711 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6e275-0298-438d-9536-19003c6f314b None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.762006 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6e275-0298-438d-9536-19003c6f314b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.779649 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-f8e6e275-0298-438d-9536-19003c6f314b None None] MFA Rules not processed for user `df8711dbef0e4322ab4112544df903c1`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:07:50.780857 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-f8e6e275-0298-438d-9536-19003c6f314b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:07:50.800300 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:07:50.813418 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 590/1179] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:07:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:07:50.824487 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be9a59-9855-4911-84ca-033e073bf332 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:50.825865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-71be9a59-9855-4911-84ca-033e073bf332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:07:50.844354 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 590/1180] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:07:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:07:50.855672 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6e275-0298-438d-9536-19003c6f314b None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:50.909006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be9a59-9855-4911-84ca-033e073bf332 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:50.909639 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6e275-0298-438d-9536-19003c6f314b None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:50.913801 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c17c30-40c6-4d45-b343-f589fdb9555f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:50.913973 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d03710-fd39-4d6d-84f0-1d2bbbe72a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:50.914449 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c17c30-40c6-4d45-b343-f589fdb9555f service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.914639 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d03710-fd39-4d6d-84f0-1d2bbbe72a98 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:50.914821 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c17c30-40c6-4d45-b343-f589fdb9555f service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.915024 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d03710-fd39-4d6d-84f0-1d2bbbe72a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:50.915149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c17c30-40c6-4d45-b343-f589fdb9555f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.915331 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d03710-fd39-4d6d-84f0-1d2bbbe72a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:50.924447 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d03710-fd39-4d6d-84f0-1d2bbbe72a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:50.924573 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c17c30-40c6-4d45-b343-f589fdb9555f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:50.925892 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d03710-fd39-4d6d-84f0-1d2bbbe72a98 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:50.926013 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c17c30-40c6-4d45-b343-f589fdb9555f service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:50.936242 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 591/1181] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:07:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 12:07:50.936702 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 591/1182] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:07:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 12:07:56.160279 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac4107-4adb-4dec-a346-b54ac7bb8319 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:56.161949 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac4107-4adb-4dec-a346-b54ac7bb8319 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:56.162422 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac4107-4adb-4dec-a346-b54ac7bb8319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:56.200049 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-7eac4107-4adb-4dec-a346-b54ac7bb8319 None None] MFA Rules not processed for user `fe9a1dda0eb54af99dd4dc9849a10460`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:07:56.201332 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-7eac4107-4adb-4dec-a346-b54ac7bb8319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:07:56.354393 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 592/1183] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:07:56 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:07:56.356428 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d03710-fd39-4d6d-84f0-1d2bbbe72a98 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:56.368763 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d03710-fd39-4d6d-84f0-1d2bbbe72a98 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:56.374114 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01a038-3be4-405f-8a1d-d6bc5f8305fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:56.374941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01a038-3be4-405f-8a1d-d6bc5f8305fa admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:56.375517 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01a038-3be4-405f-8a1d-d6bc5f8305fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:56.375889 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01a038-3be4-405f-8a1d-d6bc5f8305fa admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:56.376691 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01a038-3be4-405f-8a1d-d6bc5f8305fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:56.378898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01a038-3be4-405f-8a1d-d6bc5f8305fa admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:56.438161 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 592/1184] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Jul 11 12:07:56 2022] POST /identity/v3/projects => generated 379 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 12:07:56.442145 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac4107-4adb-4dec-a346-b54ac7bb8319 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:56.462539 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac4107-4adb-4dec-a346-b54ac7bb8319 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:56.521718 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:07:56.585479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214adc1a-9e2e-4a42-8b40-2ca5628d8379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:56.586308 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214adc1a-9e2e-4a42-8b40-2ca5628d8379 admin admin] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:56.586688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214adc1a-9e2e-4a42-8b40-2ca5628d8379 admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:56.587088 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214adc1a-9e2e-4a42-8b40-2ca5628d8379 admin admin] PATH_INFO: `/v3/users` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:56.587988 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214adc1a-9e2e-4a42-8b40-2ca5628d8379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:56.590045 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214adc1a-9e2e-4a42-8b40-2ca5628d8379 admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:56.616497 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29640726-6fa8-4456-9959-b60b449dfcbd None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:56.616985 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29640726-6fa8-4456-9959-b60b449dfcbd None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:56.617411 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29640726-6fa8-4456-9959-b60b449dfcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:56.641284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 593/1185] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Jul 11 12:07:56 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 12:07:56.647539 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214adc1a-9e2e-4a42-8b40-2ca5628d8379 admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:56.664173 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214adc1a-9e2e-4a42-8b40-2ca5628d8379 admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:56.670182 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-29640726-6fa8-4456-9959-b60b449dfcbd None None] MFA Rules not processed for user `5e39058d7a1e45e0b787c42841f59000`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:07:56.670586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2efbd9-a008-4b9d-a830-2bd3feb90db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:56.671436 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2efbd9-a008-4b9d-a830-2bd3feb90db7 admin admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:56.671689 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-29640726-6fa8-4456-9959-b60b449dfcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:07:56.671860 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2efbd9-a008-4b9d-a830-2bd3feb90db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:56.672207 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2efbd9-a008-4b9d-a830-2bd3feb90db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:56.672999 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2efbd9-a008-4b9d-a830-2bd3feb90db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:56.675339 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2efbd9-a008-4b9d-a830-2bd3feb90db7 admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:56.689213 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 594/1186] 10.222.0.25 () {58 vars in 1121 bytes} [Mon Jul 11 12:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 12:07:56.693650 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2efbd9-a008-4b9d-a830-2bd3feb90db7 admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:56.707035 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2efbd9-a008-4b9d-a830-2bd3feb90db7 admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:56.713097 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5aba4-d3f8-4686-af9b-857957ec453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:56.714328 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5aba4-d3f8-4686-af9b-857957ec453b admin admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:56.714750 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5aba4-d3f8-4686-af9b-857957ec453b admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:56.715308 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5aba4-d3f8-4686-af9b-857957ec453b admin admin] PATH_INFO: `/v3/projects/176908c4f49940ec9c8971cc3f25c390/users/b4467fada03249f79a4dcbd5585e2ee3/roles/11fc9dc7c3664b2b8af8eee2462707b8` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:56.736988 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5aba4-d3f8-4686-af9b-857957ec453b admin admin] RBAC: Authorizing `identity:create_grant(project_id=176908c4f49940ec9c8971cc3f25c390, user_id=b4467fada03249f79a4dcbd5585e2ee3, role_id=11fc9dc7c3664b2b8af8eee2462707b8)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:56.740766 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5aba4-d3f8-4686-af9b-857957ec453b admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:56.752854 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 593/1187] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:07:56 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:07:56.757110 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29640726-6fa8-4456-9959-b60b449dfcbd None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:56.760117 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 595/1188] 10.222.0.25 () {60 vars in 1482 bytes} [Mon Jul 11 12:07:56 2022] PUT /identity/v3/projects/176908c4f49940ec9c8971cc3f25c390/users/b4467fada03249f79a4dcbd5585e2ee3/roles/11fc9dc7c3664b2b8af8eee2462707b8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 12:07:56.761211 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5aba4-d3f8-4686-af9b-857957ec453b admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:56.776098 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29640726-6fa8-4456-9959-b60b449dfcbd None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:56.840292 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:07:56.845386 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5aba4-d3f8-4686-af9b-857957ec453b admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:56.850557 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ea5c0-409e-445e-a74d-f2bc0a97c30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:56.851254 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fd83c-4841-433a-8681-115d4d2b81d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:56.851860 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ea5c0-409e-445e-a74d-f2bc0a97c30c admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:56.852114 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fd83c-4841-433a-8681-115d4d2b81d5 admin admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:56.852275 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fd83c-4841-433a-8681-115d4d2b81d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:56.852529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ea5c0-409e-445e-a74d-f2bc0a97c30c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:56.852668 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fd83c-4841-433a-8681-115d4d2b81d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:56.852838 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ea5c0-409e-445e-a74d-f2bc0a97c30c admin admin] PATH_INFO: `/v3/projects` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:56.853831 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fd83c-4841-433a-8681-115d4d2b81d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:56.853945 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ea5c0-409e-445e-a74d-f2bc0a97c30c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:56.855231 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fd83c-4841-433a-8681-115d4d2b81d5 admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:56.857086 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ea5c0-409e-445e-a74d-f2bc0a97c30c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:56.867891 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 596/1189] 10.222.0.25 () {58 vars in 1121 bytes} [Mon Jul 11 12:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 12:07:56.873040 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fd83c-4841-433a-8681-115d4d2b81d5 admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:56.889656 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fd83c-4841-433a-8681-115d4d2b81d5 admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:56.892640 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 594/1190] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Jul 11 12:07:56 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 12:07:56.896409 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ea5c0-409e-445e-a74d-f2bc0a97c30c admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:56.897852 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6231e52-2f26-4d79-bea3-d043d908aa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:56.899432 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6231e52-2f26-4d79-bea3-d043d908aa01 admin admin] REQUEST_METHOD: `PUT` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:56.899432 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6231e52-2f26-4d79-bea3-d043d908aa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:56.899635 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6231e52-2f26-4d79-bea3-d043d908aa01 admin admin] PATH_INFO: `/v3/projects/176908c4f49940ec9c8971cc3f25c390/users/b4467fada03249f79a4dcbd5585e2ee3/roles/11fc9dc7c3664b2b8af8eee2462707b8` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:56.903064 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6231e52-2f26-4d79-bea3-d043d908aa01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=176908c4f49940ec9c8971cc3f25c390, user_id=b4467fada03249f79a4dcbd5585e2ee3, role_id=11fc9dc7c3664b2b8af8eee2462707b8)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:56.907761 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6231e52-2f26-4d79-bea3-d043d908aa01 admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:56.928057 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 597/1191] 10.222.0.25 () {60 vars in 1482 bytes} [Mon Jul 11 12:07:56 2022] PUT /identity/v3/projects/176908c4f49940ec9c8971cc3f25c390/users/b4467fada03249f79a4dcbd5585e2ee3/roles/11fc9dc7c3664b2b8af8eee2462707b8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 12:07:56.968946 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ea5c0-409e-445e-a74d-f2bc0a97c30c admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:57.036661 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdb9dd-4014-4b75-81d4-e9b1e040efef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:57.037574 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdb9dd-4014-4b75-81d4-e9b1e040efef admin admin] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:57.037804 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdb9dd-4014-4b75-81d4-e9b1e040efef admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:57.038064 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdb9dd-4014-4b75-81d4-e9b1e040efef admin admin] PATH_INFO: `/v3/users` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:57.039700 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fdb9dd-4014-4b75-81d4-e9b1e040efef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:57.041692 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fdb9dd-4014-4b75-81d4-e9b1e040efef admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:57.067741 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 595/1192] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Jul 11 12:07:56 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 12:07:57.071525 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6231e52-2f26-4d79-bea3-d043d908aa01 admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:57.085267 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6231e52-2f26-4d79-bea3-d043d908aa01 admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:57.093092 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f933eb-cb59-4ee9-b6e6-d05098e0dc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:57.093841 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f933eb-cb59-4ee9-b6e6-d05098e0dc93 admin admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:57.094405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f933eb-cb59-4ee9-b6e6-d05098e0dc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:57.095212 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f933eb-cb59-4ee9-b6e6-d05098e0dc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:57.096743 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f933eb-cb59-4ee9-b6e6-d05098e0dc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:57.097830 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f933eb-cb59-4ee9-b6e6-d05098e0dc93 admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:57.112697 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 598/1193] 10.222.0.25 () {58 vars in 1121 bytes} [Mon Jul 11 12:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 12:07:57.115792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdb9dd-4014-4b75-81d4-e9b1e040efef admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:57.142394 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdb9dd-4014-4b75-81d4-e9b1e040efef admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:57.157077 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee697edb-1482-461f-b5f4-d3859bd1f0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:57.160658 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee697edb-1482-461f-b5f4-d3859bd1f0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:57.162452 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee697edb-1482-461f-b5f4-d3859bd1f0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:57.163350 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee697edb-1482-461f-b5f4-d3859bd1f0c4 admin admin] PATH_INFO: `/v3/projects/19766ca5f8b9424c976aa9af02a9cfc8/users/f74453e8e8d842aba2cafe07efba4036/roles/11fc9dc7c3664b2b8af8eee2462707b8` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:57.197515 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee697edb-1482-461f-b5f4-d3859bd1f0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19766ca5f8b9424c976aa9af02a9cfc8, user_id=f74453e8e8d842aba2cafe07efba4036, role_id=11fc9dc7c3664b2b8af8eee2462707b8)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:57.200320 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee697edb-1482-461f-b5f4-d3859bd1f0c4 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:57.225066 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 596/1194] 10.222.0.25 () {60 vars in 1482 bytes} [Mon Jul 11 12:07:57 2022] PUT /identity/v3/projects/19766ca5f8b9424c976aa9af02a9cfc8/users/f74453e8e8d842aba2cafe07efba4036/roles/11fc9dc7c3664b2b8af8eee2462707b8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 12:07:57.230626 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f933eb-cb59-4ee9-b6e6-d05098e0dc93 admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:57.248906 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f933eb-cb59-4ee9-b6e6-d05098e0dc93 admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:57.360947 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:07:57.388913 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe50d0e-59e4-4f5f-b598-28b7fd2935da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:57.389904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe50d0e-59e4-4f5f-b598-28b7fd2935da admin admin] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:57.390348 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe50d0e-59e4-4f5f-b598-28b7fd2935da admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:57.390797 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe50d0e-59e4-4f5f-b598-28b7fd2935da admin admin] PATH_INFO: `/v3/roles` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:57.392265 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe50d0e-59e4-4f5f-b598-28b7fd2935da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:57.394072 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe50d0e-59e4-4f5f-b598-28b7fd2935da admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:57.418242 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 599/1195] 10.222.0.25 () {58 vars in 1121 bytes} [Mon Jul 11 12:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 12:07:57.424382 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee697edb-1482-461f-b5f4-d3859bd1f0c4 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:07:57.447891 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee697edb-1482-461f-b5f4-d3859bd1f0c4 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:07:57.465790 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613923e3-92ec-4d49-a622-023d4018f87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:07:57.466699 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613923e3-92ec-4d49-a622-023d4018f87b admin admin] REQUEST_METHOD: `PUT` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:07:57.467228 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613923e3-92ec-4d49-a622-023d4018f87b admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:07:57.467674 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613923e3-92ec-4d49-a622-023d4018f87b admin admin] PATH_INFO: `/v3/projects/19766ca5f8b9424c976aa9af02a9cfc8/users/f74453e8e8d842aba2cafe07efba4036/roles/11fc9dc7c3664b2b8af8eee2462707b8` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:07:57.471778 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613923e3-92ec-4d49-a622-023d4018f87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=19766ca5f8b9424c976aa9af02a9cfc8, user_id=f74453e8e8d842aba2cafe07efba4036, role_id=11fc9dc7c3664b2b8af8eee2462707b8)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:07:57.475549 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613923e3-92ec-4d49-a622-023d4018f87b admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:07:57.504625 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 597/1196] 10.222.0.25 () {60 vars in 1482 bytes} [Mon Jul 11 12:07:57 2022] PUT /identity/v3/projects/19766ca5f8b9424c976aa9af02a9cfc8/users/f74453e8e8d842aba2cafe07efba4036/roles/11fc9dc7c3664b2b8af8eee2462707b8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 12:08:03.981023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83878af8-8869-4087-ad34-99e7073c22f8 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:03.981512 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83878af8-8869-4087-ad34-99e7073c22f8 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:03.981616 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83878af8-8869-4087-ad34-99e7073c22f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:04.019915 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-83878af8-8869-4087-ad34-99e7073c22f8 None None] MFA Rules not processed for user `b4467fada03249f79a4dcbd5585e2ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:08:04.022604 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-83878af8-8869-4087-ad34-99e7073c22f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:08:04.123984 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 600/1197] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:08:03 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:08:04.135680 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613923e3-92ec-4d49-a622-023d4018f87b admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:08:04.138583 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-613923e3-92ec-4d49-a622-023d4018f87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:08:04.202286 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:08:04.240132 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613923e3-92ec-4d49-a622-023d4018f87b admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:08:04.256676 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf46127-b0a3-4421-bae2-be761e392e55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce9ec24be9049bfacddcf3c068f2f65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:08:04.258834 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf46127-b0a3-4421-bae2-be761e392e55 service glance] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:04.259336 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf46127-b0a3-4421-bae2-be761e392e55 service glance] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:04.259906 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf46127-b0a3-4421-bae2-be761e392e55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:04.366561 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf46127-b0a3-4421-bae2-be761e392e55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:08:04.368109 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf46127-b0a3-4421-bae2-be761e392e55 service glance] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:08:04.382335 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 598/1198] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:08:04 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:08:04.714030 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fd474-15a8-4ecc-befe-4df1e805b7a5 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:04.714557 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fd474-15a8-4ecc-befe-4df1e805b7a5 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:04.714996 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fd474-15a8-4ecc-befe-4df1e805b7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:04.746501 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-684fd474-15a8-4ecc-befe-4df1e805b7a5 None None] MFA Rules not processed for user `f74453e8e8d842aba2cafe07efba4036`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:08:04.747895 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-684fd474-15a8-4ecc-befe-4df1e805b7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:08:04.891947 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 601/1199] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:08:04 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:08:04.904582 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf46127-b0a3-4421-bae2-be761e392e55 service glance] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:08:04.921827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf46127-b0a3-4421-bae2-be761e392e55 service glance] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:08:04.929782 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cf181-1f5f-401f-9a6e-d8a924fd4377 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce9ec24be9049bfacddcf3c068f2f65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:08:04.930945 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cf181-1f5f-401f-9a6e-d8a924fd4377 service glance] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:04.931612 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cf181-1f5f-401f-9a6e-d8a924fd4377 service glance] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:04.932190 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cf181-1f5f-401f-9a6e-d8a924fd4377 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:05.025730 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cf181-1f5f-401f-9a6e-d8a924fd4377 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:08:05.027622 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cf181-1f5f-401f-9a6e-d8a924fd4377 service glance] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:08:05.040380 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 599/1200] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:08:04 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:08:13.427333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ad69d-e5a7-47a1-bdc3-a1ae23fd17fd None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:13.427933 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ad69d-e5a7-47a1-bdc3-a1ae23fd17fd None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:13.427933 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ad69d-e5a7-47a1-bdc3-a1ae23fd17fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:13.445315 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-089ad69d-e5a7-47a1-bdc3-a1ae23fd17fd None None] MFA Rules not processed for user `5e39058d7a1e45e0b787c42841f59000`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:08:13.446525 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-089ad69d-e5a7-47a1-bdc3-a1ae23fd17fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:08:13.453406 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 602/1201] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:08:13 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:08:13.788786 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40382e-265c-4150-876e-69195992d9bd None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:13.789482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40382e-265c-4150-876e-69195992d9bd None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:13.789482 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40382e-265c-4150-876e-69195992d9bd None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:13.791139 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 600/1202] 10.222.0.25 () {54 vars in 961 bytes} [Mon Jul 11 12:08:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:08:13.798064 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727ca16-94c0-4e5e-8c8c-f045b6b51648 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:13.798351 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727ca16-94c0-4e5e-8c8c-f045b6b51648 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:13.798638 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727ca16-94c0-4e5e-8c8c-f045b6b51648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:13.839020 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-7727ca16-94c0-4e5e-8c8c-f045b6b51648 None None] MFA Rules not processed for user `11550a0ca11041b0b9b175860f2b6633`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:08:13.840250 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-7727ca16-94c0-4e5e-8c8c-f045b6b51648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:08:13.888351 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=100 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:08:13.920383 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 603/1203] 10.222.0.25 () {58 vars in 1058 bytes} [Mon Jul 11 12:08:13 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 12:08:13.925827 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa27e11-3855-4a0f-804e-1f40575f2109 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:13.926525 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa27e11-3855-4a0f-804e-1f40575f2109 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:13.926525 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa27e11-3855-4a0f-804e-1f40575f2109 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:13.928067 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 601/1204] 10.222.0.25 () {54 vars in 912 bytes} [Mon Jul 11 12:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:08:13.933077 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817781f-8d93-4fc7-b810-e1eb4395f45e None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:13.933567 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817781f-8d93-4fc7-b810-e1eb4395f45e None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:13.934177 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817781f-8d93-4fc7-b810-e1eb4395f45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:13.956739 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-e817781f-8d93-4fc7-b810-e1eb4395f45e None None] MFA Rules not processed for user `11550a0ca11041b0b9b175860f2b6633`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:08:13.959403 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-e817781f-8d93-4fc7-b810-e1eb4395f45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:08:13.969142 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 604/1205] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Jul 11 12:08:13 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:08:13.982346 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa27e11-3855-4a0f-804e-1f40575f2109 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:08:13.984444 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-1aa27e11-3855-4a0f-804e-1f40575f2109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:08:14.002203 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa27e11-3855-4a0f-804e-1f40575f2109 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:08:14.006794 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd46e53-72dd-4684-8b96-ec7a2d5ccc47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce9ec24be9049bfacddcf3c068f2f65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:08:14.007513 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd46e53-72dd-4684-8b96-ec7a2d5ccc47 service glance] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:14.007864 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd46e53-72dd-4684-8b96-ec7a2d5ccc47 service glance] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:14.008225 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd46e53-72dd-4684-8b96-ec7a2d5ccc47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:14.018496 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd46e53-72dd-4684-8b96-ec7a2d5ccc47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:08:14.021264 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd46e53-72dd-4684-8b96-ec7a2d5ccc47 service glance] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:08:14.036668 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 602/1206] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:08:13 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:08:14.432251 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57420c5c-7d3e-43d3-81d8-11b485baeb1d None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:14.432783 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57420c5c-7d3e-43d3-81d8-11b485baeb1d None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:14.432895 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57420c5c-7d3e-43d3-81d8-11b485baeb1d None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:14.434322 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 605/1207] 10.222.0.25 () {54 vars in 912 bytes} [Mon Jul 11 12:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:08:14.439960 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfdb0b-fd62-41ad-aeb6-f9805c982b21 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:14.440330 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfdb0b-fd62-41ad-aeb6-f9805c982b21 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:14.440666 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfdb0b-fd62-41ad-aeb6-f9805c982b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:14.482512 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-54cfdb0b-fd62-41ad-aeb6-f9805c982b21 None None] MFA Rules not processed for user `2b005858b98e4e27b2536d9ea3908f09`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:08:14.484146 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-54cfdb0b-fd62-41ad-aeb6-f9805c982b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:08:14.564297 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 603/1208] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Jul 11 12:08:14 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:08:14.573768 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57420c5c-7d3e-43d3-81d8-11b485baeb1d None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:08:14.587223 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57420c5c-7d3e-43d3-81d8-11b485baeb1d None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:08:14.592207 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f776d0-04a9-4d42-bf3b-3105e6198f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:08:14.593130 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f776d0-04a9-4d42-bf3b-3105e6198f22 service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:14.593569 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f776d0-04a9-4d42-bf3b-3105e6198f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:14.593910 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f776d0-04a9-4d42-bf3b-3105e6198f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:14.604805 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f776d0-04a9-4d42-bf3b-3105e6198f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:08:14.607472 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f776d0-04a9-4d42-bf3b-3105e6198f22 service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:08:14.618952 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 606/1209] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:08:14 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:08:15.281431 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8623e5-ce7a-465f-83c3-8c2b172cbf2e None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:15.281971 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8623e5-ce7a-465f-83c3-8c2b172cbf2e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:15.282081 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8623e5-ce7a-465f-83c3-8c2b172cbf2e None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:15.283723 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 604/1210] 10.222.0.25 () {54 vars in 961 bytes} [Mon Jul 11 12:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 12:08:15.292028 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e80e5-4f2b-405f-84a0-8719829e3506 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:15.292405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e80e5-4f2b-405f-84a0-8719829e3506 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:15.292757 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e80e5-4f2b-405f-84a0-8719829e3506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:15.310228 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0163405-d12f-4292-b869-3c2b4bbc21e7 None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:15.310534 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0163405-d12f-4292-b869-3c2b4bbc21e7 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:15.310845 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0163405-d12f-4292-b869-3c2b4bbc21e7 None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:15.312606 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 605/1211] 10.222.0.25 () {54 vars in 960 bytes} [Mon Jul 11 12:08:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:08:15.321618 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51554696-9571-43fc-950d-11589ec4803c None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:15.321993 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51554696-9571-43fc-950d-11589ec4803c None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:15.322529 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51554696-9571-43fc-950d-11589ec4803c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:15.333694 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-108e80e5-4f2b-405f-84a0-8719829e3506 None None] MFA Rules not processed for user `11550a0ca11041b0b9b175860f2b6633`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:08:15.335629 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-108e80e5-4f2b-405f-84a0-8719829e3506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:08:15.355210 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 607/1212] 10.222.0.25 () {58 vars in 1058 bytes} [Mon Jul 11 12:08:15 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:08:15.361555 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c0a6a-d35b-4cb2-acd2-5ef4cd439422 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:15.361924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c0a6a-d35b-4cb2-acd2-5ef4cd439422 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:15.362315 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c0a6a-d35b-4cb2-acd2-5ef4cd439422 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:15.364862 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-51554696-9571-43fc-950d-11589ec4803c None None] MFA Rules not processed for user `fc6d2bcfca0a495582d322494b054045`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:08:15.366793 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-51554696-9571-43fc-950d-11589ec4803c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:08:15.369508 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 608/1213] 10.222.0.25 () {54 vars in 912 bytes} [Mon Jul 11 12:08:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 12:08:15.371061 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b74a-1275-4091-b224-1378584f2a5c None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:15.371423 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b74a-1275-4091-b224-1378584f2a5c None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:15.371765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b74a-1275-4091-b224-1378584f2a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:15.388683 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:08:15.392666 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-4663b74a-1275-4091-b224-1378584f2a5c None None] MFA Rules not processed for user `11550a0ca11041b0b9b175860f2b6633`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:08:15.394149 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-4663b74a-1275-4091-b224-1378584f2a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:08:15.413246 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 609/1214] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Jul 11 12:08:15 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:08:15.419379 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b74a-1275-4091-b224-1378584f2a5c None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:08:15.429306 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b74a-1275-4091-b224-1378584f2a5c None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:08:15.433989 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcd636-4016-4d1f-b4b7-0b64e991f301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:08:15.435024 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcd636-4016-4d1f-b4b7-0b64e991f301 service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:15.435322 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcd636-4016-4d1f-b4b7-0b64e991f301 service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:15.435603 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcd636-4016-4d1f-b4b7-0b64e991f301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:15.456827 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcd636-4016-4d1f-b4b7-0b64e991f301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:08:15.459374 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcd636-4016-4d1f-b4b7-0b64e991f301 service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:08:15.474808 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 610/1215] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:08:15 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 12:08:15.479967 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 606/1216] 10.222.0.25 () {58 vars in 1057 bytes} [Mon Jul 11 12:08:15 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:08:15.488500 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcd636-4016-4d1f-b4b7-0b64e991f301 service neutron] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:08:15.504799 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcd636-4016-4d1f-b4b7-0b64e991f301 service neutron] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:08:15.514795 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b7e57-a245-4a6a-b048-638f219594ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6d2bcfca0a495582d322494b054045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:08:15.518330 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b7e57-a245-4a6a-b048-638f219594ed service placement] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:15.522499 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b7e57-a245-4a6a-b048-638f219594ed service placement] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:15.522940 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b7e57-a245-4a6a-b048-638f219594ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:15.525236 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-9f7b7e57-a245-4a6a-b048-638f219594ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:08:15.544430 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b7e57-a245-4a6a-b048-638f219594ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:08:15.547281 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b7e57-a245-4a6a-b048-638f219594ed service placement] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:08:15.569237 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 611/1217] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:08:15 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:08:25.466772 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=21 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:08:25.562443 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=37 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:08:28.085738 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d4baf-8d63-4ec8-9397-179ae4d01177 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:28.086325 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d4baf-8d63-4ec8-9397-179ae4d01177 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:28.086430 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d4baf-8d63-4ec8-9397-179ae4d01177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:28.105909 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-229d4baf-8d63-4ec8-9397-179ae4d01177 None None] MFA Rules not processed for user `2b005858b98e4e27b2536d9ea3908f09`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:08:28.107391 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-229d4baf-8d63-4ec8-9397-179ae4d01177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:08:28.114096 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 607/1218] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Jul 11 12:08:28 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:08:28.125446 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b7e57-a245-4a6a-b048-638f219594ed service placement] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:08:28.143461 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b7e57-a245-4a6a-b048-638f219594ed service placement] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:08:28.147997 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e6cc7-f61c-4a02-ac37-d9692b97284e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:08:28.148647 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e6cc7-f61c-4a02-ac37-d9692b97284e service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:28.148935 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e6cc7-f61c-4a02-ac37-d9692b97284e service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:28.149209 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e6cc7-f61c-4a02-ac37-d9692b97284e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:28.156871 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e6cc7-f61c-4a02-ac37-d9692b97284e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:08:28.158288 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e6cc7-f61c-4a02-ac37-d9692b97284e service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:08:28.168993 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 612/1219] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:08:28 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 12:08:28.923646 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb2bfa-582c-4d12-ac0e-66e97ef8ddbf None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:28.923883 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb2bfa-582c-4d12-ac0e-66e97ef8ddbf None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:28.924163 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb2bfa-582c-4d12-ac0e-66e97ef8ddbf None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:28.925743 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 608/1220] 10.222.0.25 () {54 vars in 921 bytes} [Mon Jul 11 12:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:08:28.965869 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0462de-3ed4-44f0-be24-c473a8b23dc2 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:28.966165 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0462de-3ed4-44f0-be24-c473a8b23dc2 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:28.966586 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0462de-3ed4-44f0-be24-c473a8b23dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:28.993395 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-5b0462de-3ed4-44f0-be24-c473a8b23dc2 None None] MFA Rules not processed for user `11550a0ca11041b0b9b175860f2b6633`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:08:28.994685 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-5b0462de-3ed4-44f0-be24-c473a8b23dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:08:29.010843 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 613/1221] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Jul 11 12:08:28 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:08:29.026026 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb2bfa-582c-4d12-ac0e-66e97ef8ddbf None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:08:29.043682 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb2bfa-582c-4d12-ac0e-66e97ef8ddbf None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:08:29.056756 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffd48b-2524-4a82-9f1f-4cb7fe4cd16b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:08:29.058510 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffd48b-2524-4a82-9f1f-4cb7fe4cd16b service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:29.059072 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffd48b-2524-4a82-9f1f-4cb7fe4cd16b service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:29.059820 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffd48b-2524-4a82-9f1f-4cb7fe4cd16b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:29.071461 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffd48b-2524-4a82-9f1f-4cb7fe4cd16b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:08:29.074047 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffd48b-2524-4a82-9f1f-4cb7fe4cd16b service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:08:29.087225 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 609/1222] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:08:29 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:08:36.922578 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8649e66-12d4-4db4-acbc-5a8ad5e9a8ce None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:36.923157 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8649e66-12d4-4db4-acbc-5a8ad5e9a8ce None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:36.923437 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8649e66-12d4-4db4-acbc-5a8ad5e9a8ce None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:36.924952 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 614/1223] 10.222.0.25 () {54 vars in 921 bytes} [Mon Jul 11 12:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:08:36.936530 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edcaed-07d7-4135-8673-c71e775bff6e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:36.937019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edcaed-07d7-4135-8673-c71e775bff6e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:36.937019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edcaed-07d7-4135-8673-c71e775bff6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:36.958402 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-93edcaed-07d7-4135-8673-c71e775bff6e None None] MFA Rules not processed for user `11550a0ca11041b0b9b175860f2b6633`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:08:36.960009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-93edcaed-07d7-4135-8673-c71e775bff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:08:36.969044 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 610/1224] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Jul 11 12:08:36 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:08:36.985484 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8649e66-12d4-4db4-acbc-5a8ad5e9a8ce None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:08:37.001682 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8649e66-12d4-4db4-acbc-5a8ad5e9a8ce None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:08:37.008477 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455028c-ea9d-4931-b2b1-4c746423b6f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:08:37.009292 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455028c-ea9d-4931-b2b1-4c746423b6f2 service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:37.009650 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455028c-ea9d-4931-b2b1-4c746423b6f2 service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:37.010002 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455028c-ea9d-4931-b2b1-4c746423b6f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:37.019659 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455028c-ea9d-4931-b2b1-4c746423b6f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:08:37.021393 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455028c-ea9d-4931-b2b1-4c746423b6f2 service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:08:37.032534 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 615/1225] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:08:36 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:08:46.953256 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=12 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:08:47.027593 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=15 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:08:48.982344 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edcaed-07d7-4135-8673-c71e775bff6e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:08:48.992011 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edcaed-07d7-4135-8673-c71e775bff6e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:08:48.995828 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea42ec9-dd14-4a9a-8130-1af51b1eebfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:08:48.996470 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea42ec9-dd14-4a9a-8130-1af51b1eebfa service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:48.996748 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea42ec9-dd14-4a9a-8130-1af51b1eebfa service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:48.997018 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea42ec9-dd14-4a9a-8130-1af51b1eebfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:49.007256 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea42ec9-dd14-4a9a-8130-1af51b1eebfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:08:49.009241 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea42ec9-dd14-4a9a-8130-1af51b1eebfa service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:08:49.019864 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 611/1226] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:08:48 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:08:51.153753 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f1b00-a31d-4b4d-a4c5-55ec6ca86589 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:51.154261 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f1b00-a31d-4b4d-a4c5-55ec6ca86589 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:51.154357 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f1b00-a31d-4b4d-a4c5-55ec6ca86589 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:51.155839 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 616/1227] 10.222.0.25 () {54 vars in 921 bytes} [Mon Jul 11 12:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:08:51.162749 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060befc-951a-4588-9968-318ff49cca1b None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:51.163254 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060befc-951a-4588-9968-318ff49cca1b None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:51.163480 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060befc-951a-4588-9968-318ff49cca1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:51.197597 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-8060befc-951a-4588-9968-318ff49cca1b None None] MFA Rules not processed for user `11550a0ca11041b0b9b175860f2b6633`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:08:51.199057 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-8060befc-951a-4588-9968-318ff49cca1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:08:51.210367 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 612/1228] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Jul 11 12:08:51 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:08:51.227647 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f1b00-a31d-4b4d-a4c5-55ec6ca86589 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:08:51.250599 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f1b00-a31d-4b4d-a4c5-55ec6ca86589 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:08:51.257322 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c0089-cdd1-4113-94ac-567949347081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:08:51.258820 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c0089-cdd1-4113-94ac-567949347081 service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:08:51.259284 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c0089-cdd1-4113-94ac-567949347081 service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:08:51.259564 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c0089-cdd1-4113-94ac-567949347081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:08:51.276904 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c0089-cdd1-4113-94ac-567949347081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:08:51.278882 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c0089-cdd1-4113-94ac-567949347081 service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:08:51.292659 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 617/1229] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:08:51 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:09:01.190309 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=9 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:09:01.287576 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=6 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:09:02.006844 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65abc34-4cd7-41d3-8332-9b7d634beba7 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:09:02.007140 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65abc34-4cd7-41d3-8332-9b7d634beba7 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:09:02.007419 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65abc34-4cd7-41d3-8332-9b7d634beba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:09:02.025305 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-a65abc34-4cd7-41d3-8332-9b7d634beba7 None None] MFA Rules not processed for user `fe9a1dda0eb54af99dd4dc9849a10460`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:09:02.026478 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-a65abc34-4cd7-41d3-8332-9b7d634beba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:09:02.033266 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 613/1230] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:09:02 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:09:02.350513 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd3add-809b-470c-90ac-5e39542758ac None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:09:02.351051 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd3add-809b-470c-90ac-5e39542758ac None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:09:02.351156 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd3add-809b-470c-90ac-5e39542758ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:09:02.369308 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-5dcd3add-809b-470c-90ac-5e39542758ac None None] MFA Rules not processed for user `2b005858b98e4e27b2536d9ea3908f09`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:09:02.370418 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-5dcd3add-809b-470c-90ac-5e39542758ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:09:02.376852 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 618/1231] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Jul 11 12:09:02 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:09:02.387603 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65abc34-4cd7-41d3-8332-9b7d634beba7 None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:09:02.397550 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65abc34-4cd7-41d3-8332-9b7d634beba7 None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:09:02.401076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93a6d6-55fc-475d-96de-33e88609fdaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:09:02.401739 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93a6d6-55fc-475d-96de-33e88609fdaf service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:09:02.402019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93a6d6-55fc-475d-96de-33e88609fdaf service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:09:02.402293 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93a6d6-55fc-475d-96de-33e88609fdaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:09:02.409298 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93a6d6-55fc-475d-96de-33e88609fdaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:09:02.410736 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93a6d6-55fc-475d-96de-33e88609fdaf service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:09:02.418950 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 614/1232] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:09:02 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 12:09:12.364536 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=3 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:09:12.415670 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=9 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:09:28.251976 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8c960-b795-4c76-9caa-14933594be1f None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:09:28.252425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8c960-b795-4c76-9caa-14933594be1f None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:09:28.252668 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8c960-b795-4c76-9caa-14933594be1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:09:28.269979 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-9cb8c960-b795-4c76-9caa-14933594be1f None None] MFA Rules not processed for user `fe9a1dda0eb54af99dd4dc9849a10460`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:09:28.271234 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-9cb8c960-b795-4c76-9caa-14933594be1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:09:28.278030 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 619/1233] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:09:28 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:09:38.264977 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=3 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:09:42.832612 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53a6bb-d3f2-403c-b798-ea01c9b7a9ba None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:09:42.833076 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53a6bb-d3f2-403c-b798-ea01c9b7a9ba None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:09:42.833166 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53a6bb-d3f2-403c-b798-ea01c9b7a9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:09:42.850621 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-7f53a6bb-d3f2-403c-b798-ea01c9b7a9ba None None] MFA Rules not processed for user `fe9a1dda0eb54af99dd4dc9849a10460`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:09:42.851768 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-7f53a6bb-d3f2-403c-b798-ea01c9b7a9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:09:42.858898 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 615/1234] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:09:42 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:09:52.845415 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:10:43.580217 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6e8d2-c0f9-419f-9330-7011304a9526 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:10:43.580700 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6e8d2-c0f9-419f-9330-7011304a9526 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:10:43.580802 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6e8d2-c0f9-419f-9330-7011304a9526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:10:43.598248 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-c8f6e8d2-c0f9-419f-9330-7011304a9526 None None] MFA Rules not processed for user `fe9a1dda0eb54af99dd4dc9849a10460`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:10:43.599464 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-c8f6e8d2-c0f9-419f-9330-7011304a9526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:10:43.607657 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 620/1235] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:10:43 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:10:53.593235 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=3 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:10:56.351558 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53a6bb-d3f2-403c-b798-ea01c9b7a9ba None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:10:56.370140 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53a6bb-d3f2-403c-b798-ea01c9b7a9ba None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:10:56.373696 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72b687-d71c-4326-89c4-6f02624a5a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:10:56.374329 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72b687-d71c-4326-89c4-6f02624a5a97 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:10:56.374616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72b687-d71c-4326-89c4-6f02624a5a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:10:56.374918 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72b687-d71c-4326-89c4-6f02624a5a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:10:56.384285 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72b687-d71c-4326-89c4-6f02624a5a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:10:56.385722 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72b687-d71c-4326-89c4-6f02624a5a97 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:10:56.395061 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 616/1236] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:10:56 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:11:06.391042 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=10 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:12:02.171070 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6e8d2-c0f9-419f-9330-7011304a9526 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:12:02.192366 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6e8d2-c0f9-419f-9330-7011304a9526 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:12:02.197292 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcbfbf-76ff-4c8f-bb5a-461cc0770117 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6d2bcfca0a495582d322494b054045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:12:02.197932 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcbfbf-76ff-4c8f-bb5a-461cc0770117 service placement] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:12:02.198217 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcbfbf-76ff-4c8f-bb5a-461cc0770117 service placement] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:12:02.198489 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcbfbf-76ff-4c8f-bb5a-461cc0770117 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:12:02.206750 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcbfbf-76ff-4c8f-bb5a-461cc0770117 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:12:02.208322 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcbfbf-76ff-4c8f-bb5a-461cc0770117 service placement] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:12:02.218007 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 621/1237] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:12:02 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:12:12.214047 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=10 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:13:04.554792 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72b687-d71c-4326-89c4-6f02624a5a97 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:13:04.575586 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72b687-d71c-4326-89c4-6f02624a5a97 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:13:04.580791 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ab163-3a14-430a-bb83-5a35b99a5f2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:13:04.581435 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ab163-3a14-430a-bb83-5a35b99a5f2e service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:13:04.581717 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ab163-3a14-430a-bb83-5a35b99a5f2e service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:13:04.582019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ab163-3a14-430a-bb83-5a35b99a5f2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:13:04.590440 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ab163-3a14-430a-bb83-5a35b99a5f2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:13:04.592106 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ab163-3a14-430a-bb83-5a35b99a5f2e service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:13:04.600701 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 617/1238] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:13:04 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:13:06.924091 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e46f5-e074-4771-b479-8a4a72147f70 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:13:06.924588 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e46f5-e074-4771-b479-8a4a72147f70 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:13:06.924688 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e46f5-e074-4771-b479-8a4a72147f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:13:06.944378 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-1e1e46f5-e074-4771-b479-8a4a72147f70 None None] MFA Rules not processed for user `fe9a1dda0eb54af99dd4dc9849a10460`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:13:06.945600 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-1e1e46f5-e074-4771-b479-8a4a72147f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:13:06.952978 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 622/1239] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:13:06 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:13:13.410115 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ab163-3a14-430a-bb83-5a35b99a5f2e service nova] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:13:13.419779 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ab163-3a14-430a-bb83-5a35b99a5f2e service nova] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:13:13.423319 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f052d59-a36e-4e11-8755-3414bae2a326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:13:13.423951 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f052d59-a36e-4e11-8755-3414bae2a326 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:13:13.424239 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f052d59-a36e-4e11-8755-3414bae2a326 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:13:13.424515 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f052d59-a36e-4e11-8755-3414bae2a326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:13:13.434359 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f052d59-a36e-4e11-8755-3414bae2a326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:13:13.435835 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f052d59-a36e-4e11-8755-3414bae2a326 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:13:13.445935 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 618/1240] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:13:13 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:13:16.938572 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=3 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:13:18.110185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e46f5-e074-4771-b479-8a4a72147f70 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:13:18.120719 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e46f5-e074-4771-b479-8a4a72147f70 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:13:18.124668 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8268de-ea20-4f46-84c0-8606069083cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:13:18.125313 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8268de-ea20-4f46-84c0-8606069083cc service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:13:18.125595 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8268de-ea20-4f46-84c0-8606069083cc service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:13:18.125870 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8268de-ea20-4f46-84c0-8606069083cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:13:18.136103 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8268de-ea20-4f46-84c0-8606069083cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:13:18.137653 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8268de-ea20-4f46-84c0-8606069083cc service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:13:18.148420 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 623/1241] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:13:18 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:13:23.441413 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=16 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:13:26.119929 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f052d59-a36e-4e11-8755-3414bae2a326 service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:13:26.130148 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f052d59-a36e-4e11-8755-3414bae2a326 service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:13:26.135957 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc4f76-492f-4de7-9cf1-f33e779899b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:13:26.136597 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc4f76-492f-4de7-9cf1-f33e779899b9 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:13:26.136881 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc4f76-492f-4de7-9cf1-f33e779899b9 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:13:26.137156 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc4f76-492f-4de7-9cf1-f33e779899b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:13:26.144984 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc4f76-492f-4de7-9cf1-f33e779899b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:13:26.146567 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc4f76-492f-4de7-9cf1-f33e779899b9 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:13:26.155945 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 619/1242] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:13:26 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:13:28.143637 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=6 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:13:28.829487 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8268de-ea20-4f46-84c0-8606069083cc service neutron] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:13:28.838592 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8268de-ea20-4f46-84c0-8606069083cc service neutron] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:13:28.842567 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7ab87-4bfc-4830-b6ae-1bffc5892c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:13:28.843240 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7ab87-4bfc-4830-b6ae-1bffc5892c0a service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:13:28.843519 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7ab87-4bfc-4830-b6ae-1bffc5892c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:13:28.843793 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7ab87-4bfc-4830-b6ae-1bffc5892c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:13:28.856889 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7ab87-4bfc-4830-b6ae-1bffc5892c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:13:28.858761 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7ab87-4bfc-4830-b6ae-1bffc5892c0a service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:13:28.869019 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 624/1243] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:13:28 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:13:33.035511 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc4f76-492f-4de7-9cf1-f33e779899b9 service nova] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:13:33.049966 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc4f76-492f-4de7-9cf1-f33e779899b9 service nova] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:13:33.057068 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a997f1-fc10-4c17-9a57-846cec989ce9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:13:33.057723 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a997f1-fc10-4c17-9a57-846cec989ce9 service nova] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:13:33.058047 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a997f1-fc10-4c17-9a57-846cec989ce9 service nova] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:13:33.058262 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a997f1-fc10-4c17-9a57-846cec989ce9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:13:33.071001 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a997f1-fc10-4c17-9a57-846cec989ce9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:13:33.072891 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a997f1-fc10-4c17-9a57-846cec989ce9 service nova] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:13:33.085941 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 620/1244] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:13:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:13:38.863913 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=6 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:13:41.658829 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1090f8-00bb-4473-870c-6733ad71b111 None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:13:41.659473 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1090f8-00bb-4473-870c-6733ad71b111 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:13:41.659473 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1090f8-00bb-4473-870c-6733ad71b111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:13:41.677455 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-ad1090f8-00bb-4473-870c-6733ad71b111 None None] MFA Rules not processed for user `5e39058d7a1e45e0b787c42841f59000`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:13:41.678650 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-ad1090f8-00bb-4473-870c-6733ad71b111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:13:41.686131 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 625/1245] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:13:41 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:13:42.251233 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a997f1-fc10-4c17-9a57-846cec989ce9 service nova] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:13:42.262921 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a997f1-fc10-4c17-9a57-846cec989ce9 service nova] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:13:42.268157 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf617d-70c0-4217-8648-177f8ac01c9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6d2bcfca0a495582d322494b054045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:13:42.268841 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf617d-70c0-4217-8648-177f8ac01c9b service placement] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:13:42.269127 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf617d-70c0-4217-8648-177f8ac01c9b service placement] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:13:42.269405 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf617d-70c0-4217-8648-177f8ac01c9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:13:42.281684 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf617d-70c0-4217-8648-177f8ac01c9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:13:42.282928 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf617d-70c0-4217-8648-177f8ac01c9b service placement] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:13:42.293597 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 621/1246] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:13:42 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:13:51.672396 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=3 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:13:52.289835 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=18 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:14:00.311727 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1090f8-00bb-4473-870c-6733ad71b111 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:14:00.326451 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1090f8-00bb-4473-870c-6733ad71b111 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:14:00.331406 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68839f98-4778-4135-b558-6287ce4870a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:14:00.332055 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68839f98-4778-4135-b558-6287ce4870a4 service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:14:00.332333 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68839f98-4778-4135-b558-6287ce4870a4 service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:14:00.332605 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68839f98-4778-4135-b558-6287ce4870a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:14:00.341756 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68839f98-4778-4135-b558-6287ce4870a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:14:00.343405 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68839f98-4778-4135-b558-6287ce4870a4 service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:14:00.353903 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 626/1247] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:14:00 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:14:08.931137 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf617d-70c0-4217-8648-177f8ac01c9b service placement] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:14:08.940309 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf617d-70c0-4217-8648-177f8ac01c9b service placement] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:14:08.943814 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddade40-cadc-4fa5-8163-2a270e5c2318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:14:08.945071 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddade40-cadc-4fa5-8163-2a270e5c2318 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:14:08.945348 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddade40-cadc-4fa5-8163-2a270e5c2318 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:14:08.945616 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddade40-cadc-4fa5-8163-2a270e5c2318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:14:08.954261 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddade40-cadc-4fa5-8163-2a270e5c2318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:14:08.955723 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddade40-cadc-4fa5-8163-2a270e5c2318 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:14:08.965548 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 622/1248] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:14:08 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:14:10.349327 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=6 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:14:10.412082 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68839f98-4778-4135-b558-6287ce4870a4 service nova] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:14:10.427545 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68839f98-4778-4135-b558-6287ce4870a4 service nova] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:14:10.434277 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19460136-1b32-448e-8330-d4f8845f8bee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11550a0ca11041b0b9b175860f2b6633', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:14:10.434892 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19460136-1b32-448e-8330-d4f8845f8bee service nova] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:14:10.435176 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19460136-1b32-448e-8330-d4f8845f8bee service nova] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:14:10.435477 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19460136-1b32-448e-8330-d4f8845f8bee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:14:10.444809 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19460136-1b32-448e-8330-d4f8845f8bee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:14:10.446696 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19460136-1b32-448e-8330-d4f8845f8bee service nova] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:14:10.458412 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 627/1249] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:14:10 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:14:18.961617 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=6 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:14:20.453444 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=6 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:15:14.796257 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7584fc3-c971-438a-a894-c0f0183a5d6e None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:15:14.796806 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7584fc3-c971-438a-a894-c0f0183a5d6e None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:15:14.796806 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7584fc3-c971-438a-a894-c0f0183a5d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:15:14.814459 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-c7584fc3-c971-438a-a894-c0f0183a5d6e None None] MFA Rules not processed for user `fe9a1dda0eb54af99dd4dc9849a10460`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:15:14.815689 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-c7584fc3-c971-438a-a894-c0f0183a5d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:15:14.823065 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 623/1250] 10.222.0.25 () {58 vars in 957 bytes} [Mon Jul 11 12:15:14 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:15:15.125823 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19460136-1b32-448e-8330-d4f8845f8bee service nova] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:15:15.135553 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19460136-1b32-448e-8330-d4f8845f8bee service nova] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:15:15.139134 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24b813-e8cf-400f-bb31-55a5ffcdc223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:15:15.139765 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24b813-e8cf-400f-bb31-55a5ffcdc223 service neutron] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:15:15.140047 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24b813-e8cf-400f-bb31-55a5ffcdc223 service neutron] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:15:15.140321 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24b813-e8cf-400f-bb31-55a5ffcdc223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:15:15.147994 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24b813-e8cf-400f-bb31-55a5ffcdc223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:15:15.149431 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24b813-e8cf-400f-bb31-55a5ffcdc223 service neutron] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:15:15.158023 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 628/1251] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:15:15 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:15:24.809852 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=3 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:15:25.154145 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=6 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:16:41.830630 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7584fc3-c971-438a-a894-c0f0183a5d6e None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:16:41.851479 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7584fc3-c971-438a-a894-c0f0183a5d6e None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:16:41.855373 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba175f-807d-4010-bb4e-78c939ab9a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:16:41.856009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba175f-807d-4010-bb4e-78c939ab9a59 service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:16:41.856292 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba175f-807d-4010-bb4e-78c939ab9a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:16:41.856566 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba175f-807d-4010-bb4e-78c939ab9a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:16:41.945029 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba175f-807d-4010-bb4e-78c939ab9a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:16:41.946507 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba175f-807d-4010-bb4e-78c939ab9a59 service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:16:41.965319 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 624/1252] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:16:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:16:45.312356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2282d10-2d89-44ce-8d1d-abc18eb994b7 None None] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:16:45.312901 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2282d10-2d89-44ce-8d1d-abc18eb994b7 None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:16:45.313209 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2282d10-2d89-44ce-8d1d-abc18eb994b7 None None] PATH_INFO: `/` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:16:45.314673 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 629/1253] 10.222.0.25 () {54 vars in 921 bytes} [Mon Jul 11 12:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 12:16:45.324172 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efe394-2860-400b-892a-14c95a38bd19 None None] REQUEST_METHOD: `POST` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:16:45.324637 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efe394-2860-400b-892a-14c95a38bd19 None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:16:45.324763 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efe394-2860-400b-892a-14c95a38bd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:16:45.425064 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.auth.core [None req-61efe394-2860-400b-892a-14c95a38bd19 None None] MFA Rules not processed for user `fc6d2bcfca0a495582d322494b054045`. Rule list: `[]` (Enabled: `True`). {{(pid=87216) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:16:45.426826 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-61efe394-2860-400b-892a-14c95a38bd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:16:45.447377 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 625/1254] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Jul 11 12:16:45 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:16:45.458198 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2282d10-2d89-44ce-8d1d-abc18eb994b7 None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:16:45.471529 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2282d10-2d89-44ce-8d1d-abc18eb994b7 None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:16:45.478136 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8efd05-6875-4b89-91e7-d4d0c8416e2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6d2bcfca0a495582d322494b054045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:16:45.478810 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8efd05-6875-4b89-91e7-d4d0c8416e2d service placement] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:16:45.479098 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8efd05-6875-4b89-91e7-d4d0c8416e2d service placement] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:16:45.479630 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8efd05-6875-4b89-91e7-d4d0c8416e2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:16:45.488205 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8efd05-6875-4b89-91e7-d4d0c8416e2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:16:45.490365 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8efd05-6875-4b89-91e7-d4d0c8416e2d service placement] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:16:45.500431 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 630/1255] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:16:45 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:16:48.381851 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ee000-0767-4695-9918-cf16f76b11ae None None] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:16:48.382343 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ee000-0767-4695-9918-cf16f76b11ae None None] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:16:48.382446 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ee000-0767-4695-9918-cf16f76b11ae None None] PATH_INFO: `/` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:16:48.383836 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 626/1256] 10.222.0.25 () {54 vars in 921 bytes} [Mon Jul 11 12:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 12:16:48.394930 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294e208-0b34-4062-8f53-d7deaea560de None None] REQUEST_METHOD: `POST` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:16:48.395458 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294e208-0b34-4062-8f53-d7deaea560de None None] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:16:48.395702 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294e208-0b34-4062-8f53-d7deaea560de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:16:48.414317 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.auth.core [None req-a294e208-0b34-4062-8f53-d7deaea560de None None] MFA Rules not processed for user `fc6d2bcfca0a495582d322494b054045`. Rule list: `[]` (Enabled: `True`). {{(pid=87217) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 12:16:48.415543 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-a294e208-0b34-4062-8f53-d7deaea560de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:16:48.424095 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 631/1257] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Jul 11 12:16:48 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 12:16:48.445844 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ee000-0767-4695-9918-cf16f76b11ae None None] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:16:48.462364 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ee000-0767-4695-9918-cf16f76b11ae None None] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:16:48.467651 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3546ef3-a36e-48bd-81f9-7d775ca574ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6d2bcfca0a495582d322494b054045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:16:48.468363 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3546ef3-a36e-48bd-81f9-7d775ca574ec service placement] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:16:48.468740 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3546ef3-a36e-48bd-81f9-7d775ca574ec service placement] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:16:48.469023 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3546ef3-a36e-48bd-81f9-7d775ca574ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:16:48.474181 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294e208-0b34-4062-8f53-d7deaea560de None None] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:16:48.479492 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3546ef3-a36e-48bd-81f9-7d775ca574ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:16:48.481092 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3546ef3-a36e-48bd-81f9-7d775ca574ec service placement] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:16:48.485708 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294e208-0b34-4062-8f53-d7deaea560de None None] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:16:48.491185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212cbdf-3a6e-42a4-886f-73c668bf16dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:16:48.491849 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 627/1258] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:16:48 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:16:48.492121 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212cbdf-3a6e-42a4-886f-73c668bf16dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:16:48.492583 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212cbdf-3a6e-42a4-886f-73c668bf16dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:16:48.494161 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212cbdf-3a6e-42a4-886f-73c668bf16dd admin admin] PATH_INFO: `/v3/users/5e39058d7a1e45e0b787c42841f59000` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:16:48.495398 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212cbdf-3a6e-42a4-886f-73c668bf16dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e39058d7a1e45e0b787c42841f59000)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:16:48.496424 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: WARNING py.warnings [None req-5212cbdf-3a6e-42a4-886f-73c668bf16dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 12:16:48.496424 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: warnings.warn(msg) Jul 11 12:16:48.496424 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: Jul 11 12:16:48.497623 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212cbdf-3a6e-42a4-886f-73c668bf16dd admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:16:48.562674 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-5212cbdf-3a6e-42a4-886f-73c668bf16dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e39058d7a1e45e0b787c42841f59000'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:48.581578 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-5212cbdf-3a6e-42a4-886f-73c668bf16dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e39058d7a1e45e0b787c42841f59000'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:48.582883 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-5212cbdf-3a6e-42a4-886f-73c668bf16dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e39058d7a1e45e0b787c42841f59000'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:48.592997 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-5212cbdf-3a6e-42a4-886f-73c668bf16dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e39058d7a1e45e0b787c42841f59000'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:48.600836 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-5212cbdf-3a6e-42a4-886f-73c668bf16dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e39058d7a1e45e0b787c42841f59000'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:48.607401 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 632/1259] 10.222.0.25 () {58 vars in 1223 bytes} [Mon Jul 11 12:16:48 2022] DELETE /identity/v3/users/5e39058d7a1e45e0b787c42841f59000 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 12:16:48.780175 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3546ef3-a36e-48bd-81f9-7d775ca574ec service placement] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:16:48.793206 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3546ef3-a36e-48bd-81f9-7d775ca574ec service placement] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:16:48.825788 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=100 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:16:48.858032 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849caf5-4290-4879-9d97-e2d276ab178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:16:48.858840 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849caf5-4290-4879-9d97-e2d276ab178d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:16:48.859123 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849caf5-4290-4879-9d97-e2d276ab178d admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:16:48.859400 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849caf5-4290-4879-9d97-e2d276ab178d admin admin] PATH_INFO: `/v3/projects/2696c6e029fc42c1836959bf5a4f745a` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:16:48.860567 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849caf5-4290-4879-9d97-e2d276ab178d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2696c6e029fc42c1836959bf5a4f745a)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:16:48.861590 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: WARNING py.warnings [None req-3849caf5-4290-4879-9d97-e2d276ab178d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 12:16:48.861590 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: warnings.warn(msg) Jul 11 12:16:48.861590 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: Jul 11 12:16:48.862821 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849caf5-4290-4879-9d97-e2d276ab178d admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:16:48.918337 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3849caf5-4290-4879-9d97-e2d276ab178d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2696c6e029fc42c1836959bf5a4f745a', 'request_id': 'req-3849caf5-4290-4879-9d97-e2d276ab178d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:48.931704 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3849caf5-4290-4879-9d97-e2d276ab178d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2696c6e029fc42c1836959bf5a4f745a', 'request_id': 'req-3849caf5-4290-4879-9d97-e2d276ab178d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:48.937736 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3849caf5-4290-4879-9d97-e2d276ab178d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2696c6e029fc42c1836959bf5a4f745a', 'request_id': 'req-3849caf5-4290-4879-9d97-e2d276ab178d'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:48.961974 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3849caf5-4290-4879-9d97-e2d276ab178d admin admin] The token cache is being invalidate because project 2696c6e029fc42c1836959bf5a4f745a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 12:16:48.962255 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3849caf5-4290-4879-9d97-e2d276ab178d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:48.962902 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-3849caf5-4290-4879-9d97-e2d276ab178d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:48.964418 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 628/1260] 10.222.0.25 () {58 vars in 1232 bytes} [Mon Jul 11 12:16:48 2022] DELETE /identity/v3/projects/2696c6e029fc42c1836959bf5a4f745a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 12:16:48.968335 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212cbdf-3a6e-42a4-886f-73c668bf16dd admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:16:48.969751 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-5212cbdf-3a6e-42a4-886f-73c668bf16dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:16:48.983775 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212cbdf-3a6e-42a4-886f-73c668bf16dd admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:16:49.038856 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfff38-3db0-4f64-86d6-7adfefbd7738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:16:49.039728 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfff38-3db0-4f64-86d6-7adfefbd7738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:16:49.040012 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfff38-3db0-4f64-86d6-7adfefbd7738 admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:16:49.040290 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfff38-3db0-4f64-86d6-7adfefbd7738 admin admin] PATH_INFO: `/v3/users/f74453e8e8d842aba2cafe07efba4036` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:16:49.041479 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfff38-3db0-4f64-86d6-7adfefbd7738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74453e8e8d842aba2cafe07efba4036)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:16:49.043461 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfff38-3db0-4f64-86d6-7adfefbd7738 admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:16:49.089060 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-f6dfff38-3db0-4f64-86d6-7adfefbd7738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74453e8e8d842aba2cafe07efba4036'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:49.094425 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:16:49.103913 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-f6dfff38-3db0-4f64-86d6-7adfefbd7738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74453e8e8d842aba2cafe07efba4036'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:49.104900 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-f6dfff38-3db0-4f64-86d6-7adfefbd7738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74453e8e8d842aba2cafe07efba4036'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:49.112144 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-f6dfff38-3db0-4f64-86d6-7adfefbd7738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74453e8e8d842aba2cafe07efba4036'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:49.120297 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-f6dfff38-3db0-4f64-86d6-7adfefbd7738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74453e8e8d842aba2cafe07efba4036'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:49.126611 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 633/1261] 10.222.0.25 () {58 vars in 1223 bytes} [Mon Jul 11 12:16:48 2022] DELETE /identity/v3/users/f74453e8e8d842aba2cafe07efba4036 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 12:16:49.314390 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849caf5-4290-4879-9d97-e2d276ab178d admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:16:49.315997 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-3849caf5-4290-4879-9d97-e2d276ab178d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:16:49.330254 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849caf5-4290-4879-9d97-e2d276ab178d admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:16:49.390545 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:16:49.391404 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:16:49.391690 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:16:49.391967 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c admin admin] PATH_INFO: `/v3/projects/19766ca5f8b9424c976aa9af02a9cfc8` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:16:49.393171 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=19766ca5f8b9424c976aa9af02a9cfc8)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:16:49.396239 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:16:49.442006 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:16:49.443234 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19766ca5f8b9424c976aa9af02a9cfc8', 'request_id': 'req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:49.450401 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19766ca5f8b9424c976aa9af02a9cfc8', 'request_id': 'req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:49.456176 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19766ca5f8b9424c976aa9af02a9cfc8', 'request_id': 'req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:49.469727 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c admin admin] The token cache is being invalidate because project 19766ca5f8b9424c976aa9af02a9cfc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 12:16:49.470009 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:49.470625 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:16:49.472165 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 629/1262] 10.222.0.25 () {58 vars in 1232 bytes} [Mon Jul 11 12:16:49 2022] DELETE /identity/v3/projects/19766ca5f8b9424c976aa9af02a9cfc8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 12:16:59.122877 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=10,keystone:DELETE=2,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:16:59.466863 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=7,keystone:DELETE=3,keystone:INSERT=1 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:17:06.088503 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfff38-3db0-4f64-86d6-7adfefbd7738 admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:17:06.089927 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-f6dfff38-3db0-4f64-86d6-7adfefbd7738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:17:06.158871 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfff38-3db0-4f64-86d6-7adfefbd7738 admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:17:06.218166 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830a935-c06f-4502-b236-15b4f8fb5451 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6d2bcfca0a495582d322494b054045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:17:06.218855 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830a935-c06f-4502-b236-15b4f8fb5451 service placement] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:17:06.219147 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830a935-c06f-4502-b236-15b4f8fb5451 service placement] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:17:06.219420 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830a935-c06f-4502-b236-15b4f8fb5451 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:17:06.221209 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-3830a935-c06f-4502-b236-15b4f8fb5451 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:17:06.232356 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830a935-c06f-4502-b236-15b4f8fb5451 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:17:06.233940 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830a935-c06f-4502-b236-15b4f8fb5451 service placement] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:17:06.243407 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 634/1263] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:17:06 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:17:16.239459 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=58 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:17:51.392455 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:17:51.393909 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:17:51.462726 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5e1f9-86b8-414d-b84f-f41297a9ef9c admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:17:51.467014 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429eb2d4-cf4a-4afc-a931-c4084eeb2cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b005858b98e4e27b2536d9ea3908f09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:17:51.467655 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429eb2d4-cf4a-4afc-a931-c4084eeb2cfc service neutron] REQUEST_METHOD: `GET` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:17:51.467938 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429eb2d4-cf4a-4afc-a931-c4084eeb2cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:17:51.468213 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429eb2d4-cf4a-4afc-a931-c4084eeb2cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:17:51.470119 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-429eb2d4-cf4a-4afc-a931-c4084eeb2cfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:17:51.533115 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429eb2d4-cf4a-4afc-a931-c4084eeb2cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:17:51.534570 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429eb2d4-cf4a-4afc-a931-c4084eeb2cfc service neutron] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:17:51.544571 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 630/1264] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:17:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:17:57.804578 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830a935-c06f-4502-b236-15b4f8fb5451 service placement] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:17:57.806047 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-3830a935-c06f-4502-b236-15b4f8fb5451 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:17:57.820770 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830a935-c06f-4502-b236-15b4f8fb5451 service placement] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:17:57.825339 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a42a3-dd75-4095-9505-8ae140f8a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:17:57.826199 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a42a3-dd75-4095-9505-8ae140f8a035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:17:57.826480 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a42a3-dd75-4095-9505-8ae140f8a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:17:57.826782 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a42a3-dd75-4095-9505-8ae140f8a035 admin admin] PATH_INFO: `/v3/users/fe9a1dda0eb54af99dd4dc9849a10460` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:17:57.840627 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a42a3-dd75-4095-9505-8ae140f8a035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9a1dda0eb54af99dd4dc9849a10460)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:17:57.842581 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a42a3-dd75-4095-9505-8ae140f8a035 admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:17:57.890308 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-d23a42a3-dd75-4095-9505-8ae140f8a035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9a1dda0eb54af99dd4dc9849a10460'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:57.902412 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-d23a42a3-dd75-4095-9505-8ae140f8a035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9a1dda0eb54af99dd4dc9849a10460'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:57.903089 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-d23a42a3-dd75-4095-9505-8ae140f8a035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9a1dda0eb54af99dd4dc9849a10460'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:57.909790 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-d23a42a3-dd75-4095-9505-8ae140f8a035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9a1dda0eb54af99dd4dc9849a10460'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:57.917185 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-d23a42a3-dd75-4095-9505-8ae140f8a035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9a1dda0eb54af99dd4dc9849a10460'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:57.923920 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 635/1265] 10.222.0.25 () {58 vars in 1223 bytes} [Mon Jul 11 12:17:57 2022] DELETE /identity/v3/users/fe9a1dda0eb54af99dd4dc9849a10460 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 12:17:58.101995 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429eb2d4-cf4a-4afc-a931-c4084eeb2cfc service neutron] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:17:58.114362 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429eb2d4-cf4a-4afc-a931-c4084eeb2cfc service neutron] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:17:58.171152 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3902529-adfc-4b9d-9186-4de9f5d3aa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:17:58.172012 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3902529-adfc-4b9d-9186-4de9f5d3aa15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:17:58.172294 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3902529-adfc-4b9d-9186-4de9f5d3aa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:17:58.172569 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3902529-adfc-4b9d-9186-4de9f5d3aa15 admin admin] PATH_INFO: `/v3/projects/967c43ae687c471e9bef79704d4e66e9` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:17:58.183866 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3902529-adfc-4b9d-9186-4de9f5d3aa15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=967c43ae687c471e9bef79704d4e66e9)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:17:58.185816 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3902529-adfc-4b9d-9186-4de9f5d3aa15 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:17:58.220013 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:17:58.233089 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f3902529-adfc-4b9d-9186-4de9f5d3aa15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '967c43ae687c471e9bef79704d4e66e9', 'request_id': 'req-f3902529-adfc-4b9d-9186-4de9f5d3aa15'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:58.239656 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f3902529-adfc-4b9d-9186-4de9f5d3aa15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '967c43ae687c471e9bef79704d4e66e9', 'request_id': 'req-f3902529-adfc-4b9d-9186-4de9f5d3aa15'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:58.246019 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f3902529-adfc-4b9d-9186-4de9f5d3aa15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '967c43ae687c471e9bef79704d4e66e9', 'request_id': 'req-f3902529-adfc-4b9d-9186-4de9f5d3aa15'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:58.258159 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f3902529-adfc-4b9d-9186-4de9f5d3aa15 admin admin] The token cache is being invalidate because project 967c43ae687c471e9bef79704d4e66e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 12:17:58.258442 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f3902529-adfc-4b9d-9186-4de9f5d3aa15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:58.259140 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-f3902529-adfc-4b9d-9186-4de9f5d3aa15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:58.260836 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 631/1266] 10.222.0.25 () {58 vars in 1232 bytes} [Mon Jul 11 12:17:58 2022] DELETE /identity/v3/projects/967c43ae687c471e9bef79704d4e66e9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 12:17:58.264770 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a42a3-dd75-4095-9505-8ae140f8a035 admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:17:58.266209 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-d23a42a3-dd75-4095-9505-8ae140f8a035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:17:58.279924 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a42a3-dd75-4095-9505-8ae140f8a035 admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:17:58.335392 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d046c7a-b61c-47d1-9c02-9317ab06a18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:17:58.336261 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d046c7a-b61c-47d1-9c02-9317ab06a18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:17:58.336541 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d046c7a-b61c-47d1-9c02-9317ab06a18c admin admin] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:17:58.336811 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d046c7a-b61c-47d1-9c02-9317ab06a18c admin admin] PATH_INFO: `/v3/users/b4467fada03249f79a4dcbd5585e2ee3` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:17:58.350660 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d046c7a-b61c-47d1-9c02-9317ab06a18c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4467fada03249f79a4dcbd5585e2ee3)` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:17:58.352746 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d046c7a-b61c-47d1-9c02-9317ab06a18c admin admin] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:17:58.397484 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-2d046c7a-b61c-47d1-9c02-9317ab06a18c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4467fada03249f79a4dcbd5585e2ee3'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:58.402541 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:17:58.412126 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-2d046c7a-b61c-47d1-9c02-9317ab06a18c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4467fada03249f79a4dcbd5585e2ee3'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:58.412774 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-2d046c7a-b61c-47d1-9c02-9317ab06a18c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4467fada03249f79a4dcbd5585e2ee3'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:58.420402 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-2d046c7a-b61c-47d1-9c02-9317ab06a18c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4467fada03249f79a4dcbd5585e2ee3'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:58.427415 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.notifications [None req-2d046c7a-b61c-47d1-9c02-9317ab06a18c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4467fada03249f79a4dcbd5585e2ee3'} {{(pid=87217) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:58.433431 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 636/1267] 10.222.0.25 () {58 vars in 1223 bytes} [Mon Jul 11 12:17:58 2022] DELETE /identity/v3/users/b4467fada03249f79a4dcbd5585e2ee3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 12:17:58.601890 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3902529-adfc-4b9d-9186-4de9f5d3aa15 admin admin] Authenticating user token {{(pid=87216) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:17:58.603426 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.fernet_utils [None req-f3902529-adfc-4b9d-9186-4de9f5d3aa15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87216) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:17:58.621891 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3902529-adfc-4b9d-9186-4de9f5d3aa15 admin admin] Validating token access rules against request {{(pid=87216) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:17:58.680461 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b53d9-91b0-4737-9db9-216bd7e300c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df8711dbef0e4322ab4112544df903c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33e4605bb55c438db190b2eb3cdd5cc7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87216) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:17:58.681311 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b53d9-91b0-4737-9db9-216bd7e300c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:17:58.681590 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b53d9-91b0-4737-9db9-216bd7e300c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:17:58.681865 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b53d9-91b0-4737-9db9-216bd7e300c2 admin admin] PATH_INFO: `/v3/projects/176908c4f49940ec9c8971cc3f25c390` {{(pid=87216) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:17:58.693711 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b53d9-91b0-4737-9db9-216bd7e300c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=176908c4f49940ec9c8971cc3f25c390)` {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:17:58.695763 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b53d9-91b0-4737-9db9-216bd7e300c2 admin admin] RBAC: Authorization granted {{(pid=87216) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:17:58.743754 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-410b53d9-91b0-4737-9db9-216bd7e300c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176908c4f49940ec9c8971cc3f25c390', 'request_id': 'req-410b53d9-91b0-4737-9db9-216bd7e300c2'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:58.750496 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-410b53d9-91b0-4737-9db9-216bd7e300c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176908c4f49940ec9c8971cc3f25c390', 'request_id': 'req-410b53d9-91b0-4737-9db9-216bd7e300c2'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:58.756057 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-410b53d9-91b0-4737-9db9-216bd7e300c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176908c4f49940ec9c8971cc3f25c390', 'request_id': 'req-410b53d9-91b0-4737-9db9-216bd7e300c2'} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:58.768372 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-410b53d9-91b0-4737-9db9-216bd7e300c2 admin admin] The token cache is being invalidate because project 176908c4f49940ec9c8971cc3f25c390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87216) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 12:17:58.768650 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-410b53d9-91b0-4737-9db9-216bd7e300c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:58.769255 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG keystone.notifications [None req-410b53d9-91b0-4737-9db9-216bd7e300c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87216) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 12:17:58.770788 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: [pid: 87216|app: 0|req: 632/1268] 10.222.0.25 () {58 vars in 1232 bytes} [Mon Jul 11 12:17:58 2022] DELETE /identity/v3/projects/176908c4f49940ec9c8971cc3f25c390 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 12:18:08.429766 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:DELETE=3,keystone:SELECT=10,keystone:INSERT=1 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:18:08.765501 dv-osbrick-849324-1-ceph devstack@keystone.service[87216]: DEBUG dbcounter [-] [87216] Writing DB stats keystone:SELECT=67,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87216) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 12:22:08.141779 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d046c7a-b61c-47d1-9c02-9317ab06a18c admin admin] Authenticating user token {{(pid=87217) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 12:22:08.143207 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-2d046c7a-b61c-47d1-9c02-9317ab06a18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:22:08.223524 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d046c7a-b61c-47d1-9c02-9317ab06a18c admin admin] Validating token access rules against request {{(pid=87217) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 12:22:08.281868 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23c7a8-ca1a-4fe2-adc0-4050e7e9a463 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc6d2bcfca0a495582d322494b054045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e452080fec045788d9bd5dfdb7a3c52', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87217) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 12:22:08.282518 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23c7a8-ca1a-4fe2-adc0-4050e7e9a463 service placement] REQUEST_METHOD: `GET` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 12:22:08.282832 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23c7a8-ca1a-4fe2-adc0-4050e7e9a463 service placement] SCRIPT_NAME: `/identity` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 12:22:08.283117 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23c7a8-ca1a-4fe2-adc0-4050e7e9a463 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87217) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 12:22:08.284873 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.fernet_utils [None req-7b23c7a8-ca1a-4fe2-adc0-4050e7e9a463 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87217) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 12:22:08.295821 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23c7a8-ca1a-4fe2-adc0-4050e7e9a463 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 12:22:08.297616 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23c7a8-ca1a-4fe2-adc0-4050e7e9a463 service placement] RBAC: Authorization granted {{(pid=87217) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 12:22:08.307350 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: [pid: 87217|app: 0|req: 637/1269] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Jul 11 12:22:08 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 12:22:18.303143 dv-osbrick-849324-1-ceph devstack@keystone.service[87217]: DEBUG dbcounter [-] [87217] Writing DB stats keystone:SELECT=62 {{(pid=87217) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}